Jul 20 15:36:00.509401 ip-10-0-141-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 15:36:00.509411 ip-10-0-141-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 15:36:00.509418 ip-10-0-141-8 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 15:36:00.509641 ip-10-0-141-8 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 15:36:10.570804 ip-10-0-141-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 15:36:10.570820 ip-10-0-141-8 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4d93b2e20f7940b4961dacec7151ecb2 --
Jul 20 15:38:05.617331 ip-10-0-141-8 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 15:38:07.178482 ip-10-0-141-8 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 15:38:07.178482 ip-10-0-141-8 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 15:38:07.178482 ip-10-0-141-8 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 15:38:07.178482 ip-10-0-141-8 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 15:38:07.178482 ip-10-0-141-8 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 15:38:07.179184 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.178550    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 15:38:07.182908 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182890    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:38:07.182908 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182907    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182913    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182917    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182920    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182923    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182926    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182929    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182933    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182937    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182940    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182950    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182953    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182956    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182959    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182962    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182964    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182967    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182970    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182973    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:38:07.182978 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182975    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182978    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182981    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182984    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182987    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182989    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182992    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182995    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.182998    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183000    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183003    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183005    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183008    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183010    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183013    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183016    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183018    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183020    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183023    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183026    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:38:07.183457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183029    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183032    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183034    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183037    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183039    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183042    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183044    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183046    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183049    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183051    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183054    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183056    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183058    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183061    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183064    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183067    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183070    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183073    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183075    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183078    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:38:07.184228 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183081    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183083    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183085    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183088    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183091    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183093    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183096    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183098    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183101    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183104    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183106    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183109    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183111    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183114    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183117    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183119    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183121    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183124    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183127    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183129    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:38:07.185030 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183132    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183134    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183137    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183140    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183143    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183145    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183149    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183153    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183156    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183158    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183161    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183163    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183166    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183168    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183171    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183174    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183177    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183179    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:38:07.185822 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.183182    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186006    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186024    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186029    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186035    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186039    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186044    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186049    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186053    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186057    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186062    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186066    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186070    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186074    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186079    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186083    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186087    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186092    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186096    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186100    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:38:07.186586 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186104    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186108    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186112    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186117    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186121    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186125    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186129    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186133    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186137    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186141    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186145    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186150    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186155    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186159    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186164    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186169    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186173    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186179    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186183    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186187    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:38:07.187439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186192    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186196    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186200    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186205    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186209    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186214    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186218    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186222    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186226    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186230    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186234    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186238    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186242    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186247    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186252    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186256    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186260    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186265    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186269    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186273    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:38:07.188319 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186279    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186286    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186290    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186295    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186299    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186303    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186309    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186313    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186317    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186322    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186326    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186330    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186335    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186339    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186344    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186348    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186352    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186359    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186366    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:38:07.189230 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186373    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186378    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186383    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186387    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186392    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186398    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186402    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186407    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186411    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186417    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186421    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186426    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186430    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186434    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186439    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186443    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186448    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186452    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186456    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186462    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:38:07.189740 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.186469    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187174    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187184    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187189    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187195    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187200    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187205    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187209    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187214    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187218    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187222    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187226    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187231    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187236    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187240    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187244    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187249    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187254    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187259    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187263    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:38:07.190343 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187267    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187271    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187275    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187280    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187284    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187288    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187292    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187296    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187304    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187309    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187314    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187320    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187325    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187329    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187333    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187337    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187341    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187345    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187349    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:38:07.191038 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187353    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187358    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187361    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187366    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187370    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187375    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187380    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187384    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187388    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187393    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187397    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187402    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187406    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187410    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187417    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187422    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187427    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187431    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187435    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187440    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:38:07.191658 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187444    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187448    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187452    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187471    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187477    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187482    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187486    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187490    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187495    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187499    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187503    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187509    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187514    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187521    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187525    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187529    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187533    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187538    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187542    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187546    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:38:07.192168 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187551    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187555    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187559    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187563    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187568    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187573    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187577    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187581    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187585    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187590    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187594    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187598    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187602    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187606    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187611    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187615    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187621    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187625    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187629    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:38:07.192782 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187634    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.187638    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187744    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187755    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187772    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187780    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187786    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187792    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187798    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187805    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187810    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187816    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187822    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187827    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187847    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187852    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187857    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187862    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187868    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187873    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187881    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187886    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187891    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 15:38:07.193274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187896    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187902    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187907    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187913    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187918    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187924    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187931    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187936    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187941    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187947    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187952    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187959    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187964    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187969    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187974    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187979    2569 flags.go:64] FLAG: --enable-server="true"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187984    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187990    2569 flags.go:64] FLAG: --event-burst="100"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.187995    2569 flags.go:64] FLAG: --event-qps="50"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188000    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188005    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188010    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188017    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188021    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188026    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 15:38:07.193823 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188031    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188036    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188040    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188047    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188052    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188057    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188061    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188066    2569 flags.go:64] FLAG: --feature-gates=""
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188072    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188077    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188082    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188087    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188092    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188101    2569 flags.go:64] FLAG: --help="false"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188105    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188110    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188115    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188120    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188125    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188131    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188136    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188141    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188145    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 15:38:07.194431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188150    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188154    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188160    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188164    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188169    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188173    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188178    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188183    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188188    2569 flags.go:64] FLAG: --lock-file=""
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188192    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188196    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188201    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188219    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188231    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188236    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188240    2569 flags.go:64] FLAG: --logging-format="text"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188245    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188250    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188255    2569 flags.go:64] FLAG: --manifest-url=""
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188259    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188266    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188271    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188281    2569 flags.go:64] FLAG: --max-pods="110"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188286    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188291    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 15:38:07.195039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188296    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188321    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188327    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188333    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188338    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188350    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188355    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188361    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188366    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188371    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188380    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188384    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188389    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188393    2569 flags.go:64] FLAG: --port="10250"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188399    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188403    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0496da70df25ec73a"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188408    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188413    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188418    2569 flags.go:64] FLAG: --register-node="true"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188423    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188429    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188434    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188439    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188444    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188450    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 15:38:07.195724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188455    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188460    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188465    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188469    2569 flags.go:64] FLAG: --runonce="false"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188476    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188481    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188486    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188491    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188495    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188500    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188505    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188510    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188514    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188520    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188525    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188529    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188534    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188539    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188543    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188552    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188557    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188562    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188569    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188574    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188579    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 15:38:07.196484 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188583    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188588    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188593    2569 flags.go:64] FLAG: --v="2"
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188601    2569 flags.go:64] FLAG: --version="false"
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188608    2569 flags.go:64] FLAG: --vmodule=""
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188614    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.188620    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188852    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188861    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188866    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188871    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188879    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188883    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188888    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188894    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188900    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188906    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188910    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188916    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188921    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188925    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:38:07.197116 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188929    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188933    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188938    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188942    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188947    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188951    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188955    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188959    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188963    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188967    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188971    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188975    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188979    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188986    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188990    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.188995    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189000    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189004    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189008    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189012    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:38:07.197619 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189016    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189020    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189026    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189030    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189034    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189038    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189042    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189046    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189050    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189055    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189059    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189063    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189067    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189071    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189075    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189081    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189085    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189089    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189093    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189097    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:38:07.198127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189101    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189105    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189110    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189114    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189119    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189126    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189132    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189138    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189142    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189148    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189153    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189157    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189161    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189165    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189171    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189175    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189179    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189184    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189188    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189191    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:38:07.198615 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189196    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189200    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189204    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189208    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189212    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189216    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189221    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189225    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189229    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189233    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189238    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189242    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189245    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189250    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189254    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189258    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189262    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189267    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189275    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:38:07.199161 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189280    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189285    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189290    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189296    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189301    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.189306    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.189977    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.197176    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.197192    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.198029    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.198036    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198094    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198099    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198102    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198105    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:38:07.199621 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198108    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198111    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198113    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198116    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198119    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198122    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198125    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198128    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198131    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198133    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198136    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198139    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198142    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198145    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198147    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198150    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198153    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198156    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198158    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198162    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:38:07.200023 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198166    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198169    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198171    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198174    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198177    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198179    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198182    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198185    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198187    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198190    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198193    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198195    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198198    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198200    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198203    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198206    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198208    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198211    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198214    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198216    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:38:07.200521 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198219    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198221    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198225    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198229    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198232    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198236    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198240    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198243    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198246    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198248    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198251    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198254    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198258    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198261    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198264    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198266    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198269    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198271    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:38:07.201021 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198274    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198278    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198281    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198283    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198286    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198289    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198292    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198295    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198297    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198300    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198302    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198305    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198308    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198310    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198313    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198315    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198318    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198320    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198323    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198325    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:38:07.201457 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198328    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198330    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198333    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198335    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198338    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198341    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198343    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198346    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198350    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198352    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198355    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198357    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198360    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198362    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198365    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198367    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:38:07.202001 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198370    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.198375    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198496    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198500    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198503    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198506    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198509    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198512    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198514    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198519    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198522    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198525    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198527    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198530    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198533    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 15:38:07.202381 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198535    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198538    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198540    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198544    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198547    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198549    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198552    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198555    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198557    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198562    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198566    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198568    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198571    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198574    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198576    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198579    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198582    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198584    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198587    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 15:38:07.202756 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198589    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198592    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198594    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198597    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198599    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198601    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198604    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198607    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198609    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198612    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198614    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198617    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198620    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198622    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198625    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198628    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198630    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198633    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198635    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 15:38:07.203231 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198638    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198641    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198644    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198647    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198649    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198652    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198655    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198658    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198660    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198662    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198665    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198667    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198670    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198672    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198674    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198677    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198679    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198682    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198685    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198687    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 15:38:07.203690 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198690    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198692    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198695    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198697    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198700    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198702    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198705    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198707    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198710    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198712    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198714    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198717    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198722    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198724    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198727    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198729    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198732    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198734    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198737    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198740    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 15:38:07.204320 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198742    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198745    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198748    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198750    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198753    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198755    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198758    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:07.198760    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.198766    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.198919    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.202039    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.203874    2569 server.go:1019] "Starting client certificate rotation"
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.203975    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 15:38:07.204801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.204006    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 15:38:07.206490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.206477    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 15:38:07.207650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.207621    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 15:38:07.219786 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.219767    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 20 15:38:07.223176 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.223155    2569 log.go:25] "Validated CRI v1 image API"
Jul 20 15:38:07.224097 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.224078    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 15:38:07.229128 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.229104    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9528c394-7046-4359-84f2-4d334e722d2b:/dev/nvme0n1p4 b42ac4c3-0e28-4e90-8172-4c321d2221f3:/dev/nvme0n1p3]
Jul 20 15:38:07.229218 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.229125    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 15:38:07.234113 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.233998    2569 manager.go:216] Machine: {Timestamp:2026-07-20 15:38:07.232815735 +0000 UTC m=+0.347665811 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099151 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c5bedf6d45ac5aeee153a22db8da5 SystemUUID:ec2c5bed-f6d4-5ac5-aeee-153a22db8da5 BootID:4d93b2e2-0f79-40b4-961d-acec7151ecb2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9f:2f:f3:b4:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9f:2f:f3:b4:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:51:f1:79:ae:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 15:38:07.234113 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.234107    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 15:38:07.234230 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.234193    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 15:38:07.235121 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.235096    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 15:38:07.235285 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.235125    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 15:38:07.236335 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.236324    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 15:38:07.236382 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.236338    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 15:38:07.236382 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.236345    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 15:38:07.237007 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.236997    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 15:38:07.238151 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.238141    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 15:38:07.241286 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.241274    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 15:38:07.241449 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.241440    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 15:38:07.242152 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242143    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 15:38:07.242190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242155    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 15:38:07.242190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242169    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 15:38:07.242190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242178    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 20 15:38:07.242190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242187    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 15:38:07.242560 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242549    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 15:38:07.242593 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.242567    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 15:38:07.244936 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.244915    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 15:38:07.246372 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.246355    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 15:38:07.246470 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.246394    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 15:38:07.246998 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.246986    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 15:38:07.247082 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247006    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 15:38:07.247082 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247015    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 15:38:07.247082 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247024    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 15:38:07.247082 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247035    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 15:38:07.247082 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247043    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 15:38:07.247254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247177    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 15:38:07.247254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247187    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 15:38:07.247254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247198    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 15:38:07.247254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247207    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 15:38:07.247254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247220    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 15:38:07.247254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247233    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 15:38:07.247987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247977    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 15:38:07.248045 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.247989    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 15:38:07.251243 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.251225    2569 server.go:1268] "Started kubelet"
Jul 20 15:38:07.251327 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.251292    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 15:38:07.251419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.251369    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 15:38:07.251483 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.251471    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 15:38:07.252282 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.252257    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 15:38:07.252679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.252664    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 15:38:07.252939 ip-10-0-141-8 systemd[1]: Started Kubernetes Kubelet.
Jul 20 15:38:07.256542 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.256525    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 15:38:07.258719 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.258148    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 15:38:07.258719 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.258574    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 15:38:07.258867 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.258771    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 15:38:07.259468 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.259444    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 15:38:07.261965 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.260954    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c40994d94ede01  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-20 15:38:07.251193345 +0000 UTC m=+0.366043421,LastTimestamp:2026-07-20 15:38:07.251193345 +0000 UTC m=+0.366043421,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}"
Jul 20 15:38:07.262951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.262936    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 15:38:07.263002 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.262959    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 15:38:07.263144 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.263121    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.263620 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263601    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 15:38:07.263620 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263605    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 15:38:07.263754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263631    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 15:38:07.263754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263711    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 15:38:07.263754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263720    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 15:38:07.263958 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263945    2569 factory.go:153] Registering CRI-O factory
Jul 20 15:38:07.263958 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.263960    2569 factory.go:223] Registration of the crio container factory successfully
Jul 20 15:38:07.264076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.264024    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 15:38:07.264076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.264032    2569 factory.go:55] Registering systemd factory
Jul 20 15:38:07.264076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.264039    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 20 15:38:07.264076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.264060    2569 factory.go:103] Registering Raw factory
Jul 20 15:38:07.264076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.264073    2569 manager.go:1196] Started watching for new ooms in manager
Jul 20 15:38:07.264528 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.264513    2569 manager.go:349] Starting recovery of all containers
Jul 20 15:38:07.269877 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.269824    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 15:38:07.269964 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.269900    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 15:38:07.274652 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.274635    2569 manager.go:354] Recovery completed
Jul 20 15:38:07.278453 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.278408    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldgjj"
Jul 20 15:38:07.279344 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.279332    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.281254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281236    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.281334 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281270    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.281334 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281284    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.281820 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281806    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 15:38:07.281820 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281818    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 15:38:07.281820 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281820    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.281999 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.281850    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 15:38:07.282524 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.282511    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.282588 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.282541    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.282588 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.282558    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.283406 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.283394    2569 policy_none.go:49] "None policy: Start"
Jul 20 15:38:07.283463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.283411    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 15:38:07.283463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.283421    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 15:38:07.284318 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.284255    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c40994db198988  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-20 15:38:07.281252744 +0000 UTC m=+0.396102824,LastTimestamp:2026-07-20 15:38:07.281252744 +0000 UTC m=+0.396102824,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}"
Jul 20 15:38:07.284647 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.284636    2569 policy_none.go:47] "Start"
Jul 20 15:38:07.292542 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.292350    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldgjj"
Jul 20 15:38:07.296904 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.296827    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-8.ec2.internal.18c40994db19e7fc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-8.ec2.internal,UID:ip-10-0-141-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-8.ec2.internal,},FirstTimestamp:2026-07-20 15:38:07.281276924 +0000 UTC m=+0.396127001,LastTimestamp:2026-07-20 15:38:07.281276924 +0000 UTC m=+0.396127001,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-8.ec2.internal,}"
Jul 20 15:38:07.325436 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325422    2569 manager.go:337] "Starting Device Plugin manager"
Jul 20 15:38:07.325534 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.325463    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 15:38:07.325534 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325478    2569 server.go:87] "Starting device plugin registration server"
Jul 20 15:38:07.325787 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325775    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 15:38:07.325852 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325790    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 15:38:07.325911 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325894    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 15:38:07.325997 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325979    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 15:38:07.325997 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.325994    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 15:38:07.326594 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.326573    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 15:38:07.326669 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.326630    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.426202 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.426165    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.427679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.427189    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.427679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.427218    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.427679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.427232    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.427679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.427258    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.435976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.435942    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 15:38:07.437172 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.437158    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 15:38:07.437232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.437195    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 15:38:07.437232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.437215    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 15:38:07.437328 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.437254    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 15:38:07.439817 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.439799    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:38:07.441874 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.441857    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.441936 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.441883    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-8.ec2.internal\": node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.494138 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.494113    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.538212 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.538184    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"]
Jul 20 15:38:07.538348 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.538276    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.540594 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.540564    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.540594 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.540597    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.540745 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.540606    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.541977 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.541959    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.542174 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.542159    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.542229 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.542188    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.542939 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.542923    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.543035 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.542947    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.543035 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.542960    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.543289 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.543275    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.543362 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.543299    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.543362 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.543314    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.544632 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.544615    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.544726 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.544645    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 15:38:07.545347 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.545330    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 15:38:07.545430 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.545356    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 15:38:07.545430 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.545369    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeHasSufficientPID"
Jul 20 15:38:07.564827 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.564803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b30696e4d4a2a43878c66454fe445b18-config\") pod \"kube-apiserver-proxy-ip-10-0-141-8.ec2.internal\" (UID: \"b30696e4d4a2a43878c66454fe445b18\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.564968 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.564848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a14eb8e7fba09e08b93aa31ac7513801-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"a14eb8e7fba09e08b93aa31ac7513801\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.564968 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.564870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a14eb8e7fba09e08b93aa31ac7513801-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"a14eb8e7fba09e08b93aa31ac7513801\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.571559 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.571541    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-8.ec2.internal\" not found" node="ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.576047 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.576008    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-8.ec2.internal\" not found" node="ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.594747 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.594721    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.665350 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.665319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b30696e4d4a2a43878c66454fe445b18-config\") pod \"kube-apiserver-proxy-ip-10-0-141-8.ec2.internal\" (UID: \"b30696e4d4a2a43878c66454fe445b18\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.665456 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.665359    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a14eb8e7fba09e08b93aa31ac7513801-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"a14eb8e7fba09e08b93aa31ac7513801\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.665456 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.665385    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a14eb8e7fba09e08b93aa31ac7513801-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"a14eb8e7fba09e08b93aa31ac7513801\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.665456 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.665437    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a14eb8e7fba09e08b93aa31ac7513801-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"a14eb8e7fba09e08b93aa31ac7513801\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.665456 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.665440    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b30696e4d4a2a43878c66454fe445b18-config\") pod \"kube-apiserver-proxy-ip-10-0-141-8.ec2.internal\" (UID: \"b30696e4d4a2a43878c66454fe445b18\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.665597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.665440    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a14eb8e7fba09e08b93aa31ac7513801-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal\" (UID: \"a14eb8e7fba09e08b93aa31ac7513801\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.695312 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.695286    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.796071 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.796029    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.873592 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.873517    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.879765 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:07.879748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:07.896883 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.896858    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:07.997388 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:07.997334    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:08.098016 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:08.097969    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:08.198512 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:08.198451    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:08.202627 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.202605    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 15:38:08.202788 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.202770    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 15:38:08.296755 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.296688    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 15:33:07 +0000 UTC" deadline="2028-03-07 20:48:47.848626653 +0000 UTC"
Jul 20 15:38:08.296755 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.296748    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14309h10m39.551881367s"
Jul 20 15:38:08.298851 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:08.298820    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:08.321370 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.321346    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:38:08.399121 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:08.399086    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-8.ec2.internal\" not found"
Jul 20 15:38:08.480785 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.480761    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:38:08.480940 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:08.480904    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30696e4d4a2a43878c66454fe445b18.slice/crio-a8b53342fe50241b15fb45fb92efb5410b95a5549dc77ae7adfd49a2c1126b43 WatchSource:0}: Error finding container a8b53342fe50241b15fb45fb92efb5410b95a5549dc77ae7adfd49a2c1126b43: Status 404 returned error can't find the container with id a8b53342fe50241b15fb45fb92efb5410b95a5549dc77ae7adfd49a2c1126b43
Jul 20 15:38:08.481416 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:08.481397    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14eb8e7fba09e08b93aa31ac7513801.slice/crio-673d404e17b1e7e199f437c5ca19b15b0eb9cd692ee42b5479990dc252752b9a WatchSource:0}: Error finding container 673d404e17b1e7e199f437c5ca19b15b0eb9cd692ee42b5479990dc252752b9a: Status 404 returned error can't find the container with id 673d404e17b1e7e199f437c5ca19b15b0eb9cd692ee42b5479990dc252752b9a
Jul 20 15:38:08.485069 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.485052    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:38:08.564186 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.564147    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:08.579372 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.579345    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 15:38:08.580538 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.580523    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal"
Jul 20 15:38:08.594744 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.594721    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 15:38:08.710804 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:08.710778    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:38:09.243113 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.243084    2569 apiserver.go:52] "Watching apiserver"
Jul 20 15:38:09.252558 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.252527    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 15:38:09.253562 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.253178    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-2x69d","openshift-multus/multus-additional-cni-plugins-7nz4v","openshift-network-diagnostics/network-check-target-424gk","openshift-ovn-kubernetes/ovnkube-node-ztv8w","kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jkcsr","openshift-dns/node-resolver-p8zm2","openshift-image-registry/node-ca-852hk","openshift-multus/network-metrics-daemon-bkt82","openshift-network-operator/iptables-alerter-svfdf","kube-system/global-pull-secret-syncer-rflsh","kube-system/konnectivity-agent-sm6jv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal"]
Jul 20 15:38:09.255474 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.254864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.256739 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.256706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.256852 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.256781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:09.257942 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.257852    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:09.257942 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.257921    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:09.259238 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.259216    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.259518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.259495    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.259763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.259745    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.259763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.259759    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mkfzp\""
Jul 20 15:38:09.260640 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.260624    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.262699 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.262636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.263497    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.263539    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.263603    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.265036    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.265080    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-69g6g\""
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.265277    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.265320    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.265502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.265969    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.266123    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.266402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.266390    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-csfsx\""
Jul 20 15:38:09.266933 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.266613    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.266933 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.266901    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.268717 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.268053    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.269023 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.268864    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.269023 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.268907    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.269874 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.269434    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.270908 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.270891    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.275396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04b04807-15ac-4c14-996b-fc7456ca4621-dbus\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.275396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-serviceca\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.275396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-device-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-systemd\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275493    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-log-socket\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275560    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtqg\" (UniqueName: \"kubernetes.io/projected/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-kube-api-access-nbtqg\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-var-lib-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovnkube-config\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-env-overrides\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysctl-conf\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45eb1a3c-ce14-4b93-96d3-77ee176b3614-tmp\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr4tj\" (UniqueName: \"kubernetes.io/projected/45eb1a3c-ce14-4b93-96d3-77ee176b3614-kube-api-access-qr4tj\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04b04807-15ac-4c14-996b-fc7456ca4621-kubelet-config\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-systemd-units\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-slash\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275857    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-cni-bin\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovn-node-metrics-cert\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-modprobe-d\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysconfig\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.275941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-registration-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275966    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-kubelet\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.275992    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-etc-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276086    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-kubernetes\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-tuned\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276129    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276172    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-run-netns\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-cni-netd\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276228    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovnkube-script-lib\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276251    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb6qs\" (UniqueName: \"kubernetes.io/projected/3ee2ac86-e86d-4ff0-9a76-24773f962f61-kube-api-access-nb6qs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4fff96-98b6-443e-a673-968187ab8f33-tmp-dir\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-socket-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-sys-fs\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.276490 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx68s\" (UniqueName: \"kubernetes.io/projected/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-kube-api-access-gx68s\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-run\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-sys\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-var-lib-kubelet\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-host\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276479    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-node-log\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276516    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz8j6\" (UniqueName: \"kubernetes.io/projected/0f829165-20e8-4f2b-b5d5-c01150e0c959-kube-api-access-hz8j6\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276552    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-systemd\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-lib-modules\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-host\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276615    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-ovn\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysctl-d\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d4fff96-98b6-443e-a673-968187ab8f33-hosts-file\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.277214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.276717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpkmb\" (UniqueName: \"kubernetes.io/projected/6d4fff96-98b6-443e-a673-968187ab8f33-kube-api-access-dpkmb\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.278675 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278152    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.278675 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278193    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 15:38:09.278675 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278211    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.278675 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278454    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wl8js\""
Jul 20 15:38:09.278675 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278648    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 15:38:09.279085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278722    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qjg9n\""
Jul 20 15:38:09.279085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278771    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 15:38:09.279085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278853    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.279085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278897    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.279085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.278928    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.279085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279054    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 15:38:09.279369 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279169    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 15:38:09.279422 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279393    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 15:38:09.279422 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 15:38:09.279556 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279522    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 15:38:09.279817 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279652    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 15:38:09.279817 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279698    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xcwzr\""
Jul 20 15:38:09.279974 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.279956    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 15:38:09.280161 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.280140    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 15:38:09.280255 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.280179    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wvg69\""
Jul 20 15:38:09.280591 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.280351    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kvvp2\""
Jul 20 15:38:09.280591 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.280400    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 15:38:09.280591 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.280495    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7wbnz\""
Jul 20 15:38:09.295100 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.295074    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 15:38:09.311015 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.310991    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xkp9"
Jul 20 15:38:09.318848 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.318809    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xkp9"
Jul 20 15:38:09.364904 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.364878    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 15:38:09.377317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.377471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpkmb\" (UniqueName: \"kubernetes.io/projected/6d4fff96-98b6-443e-a673-968187ab8f33-kube-api-access-dpkmb\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.377471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.377471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377407    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-kubelet\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.377471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-serviceca\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.377471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377460    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.377710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtqg\" (UniqueName: \"kubernetes.io/projected/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-kube-api-access-nbtqg\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.377710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjlnc\" (UniqueName: \"kubernetes.io/projected/699f20a3-4268-4a76-8547-9bca5ff9b9e6-kube-api-access-fjlnc\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.377710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-os-release\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.377710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377577    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c54da2ef-e717-478f-95b0-b57b158b8593-konnectivity-ca\") pod \"konnectivity-agent-sm6jv\" (UID: \"c54da2ef-e717-478f-95b0-b57b158b8593\") " pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.377710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.377653    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.377995 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.377758    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:09.377995 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.377827    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:09.877803671 +0000 UTC m=+2.992653744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:09.378151 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378130    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-serviceca\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.378222 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-systemd-units\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378222 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378234    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-slash\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378393 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-cni-bin\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378393 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378303    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-slash\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378393 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysconfig\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.378393 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378339    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-os-release\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.378393 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378366    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-conf-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.378393 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-daemon-config\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378368    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-systemd-units\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-etc-kubernetes\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378473    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4fff96-98b6-443e-a673-968187ab8f33-tmp-dir\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-registration-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-kubelet\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-cni-bin\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-socket-dir-parent\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.378650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptk4x\" (UniqueName: \"kubernetes.io/projected/6e8af669-dcfb-45e1-a68b-1cf064190c96-kube-api-access-ptk4x\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-run-ovn-kubernetes\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378703    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb6qs\" (UniqueName: \"kubernetes.io/projected/3ee2ac86-e86d-4ff0-9a76-24773f962f61-kube-api-access-nb6qs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e8af669-dcfb-45e1-a68b-1cf064190c96-cni-binary-copy\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378751    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-hostroot\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-sys-fs\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378779    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysconfig\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-run\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-sys\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-var-lib-kubelet\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378889    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/699f20a3-4268-4a76-8547-9bca5ff9b9e6-iptables-alerter-script\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.378979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-cnibin\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.379020 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-netns\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379055    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-node-log\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379078    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4fff96-98b6-443e-a673-968187ab8f33-tmp-dir\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379138    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-sys-fs\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379177    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-run\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-sys\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379252    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-var-lib-kubelet\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379310    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-node-log\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379320    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-registration-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379347    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-kubelet\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz8j6\" (UniqueName: \"kubernetes.io/projected/0f829165-20e8-4f2b-b5d5-c01150e0c959-kube-api-access-hz8j6\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-lib-modules\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379593    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-host\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-ovn\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysctl-d\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379719    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-host\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379724    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-lib-modules\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d4fff96-98b6-443e-a673-968187ab8f33-hosts-file\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379772    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-ovn\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379824    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d4fff96-98b6-443e-a673-968187ab8f33-hosts-file\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/699f20a3-4268-4a76-8547-9bca5ff9b9e6-host-slash\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-system-cni-dir\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04b04807-15ac-4c14-996b-fc7456ca4621-dbus\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysctl-d\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.379951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379945    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-device-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-systemd\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.379992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-device-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380015    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-log-socket\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380063    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-systemd\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-run-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-env-overrides\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04b04807-15ac-4c14-996b-fc7456ca4621-dbus\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380112    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-log-socket\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380110    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-var-lib-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovnkube-config\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.380183    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:09.380596 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysctl-conf\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.381147 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.380631    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:09.88060629 +0000 UTC m=+2.995456357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:09.381204 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45eb1a3c-ce14-4b93-96d3-77ee176b3614-tmp\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.381256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr4tj\" (UniqueName: \"kubernetes.io/projected/45eb1a3c-ce14-4b93-96d3-77ee176b3614-kube-api-access-qr4tj\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.381311 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.381368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381317    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.381368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381354    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04b04807-15ac-4c14-996b-fc7456ca4621-kubelet-config\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.381463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.381463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovn-node-metrics-cert\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.381463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-modprobe-d\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.381636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snqpf\" (UniqueName: \"kubernetes.io/projected/c630dde8-7dd2-4f55-afa4-e9e50aff5624-kube-api-access-snqpf\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.381636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-k8s-cni-cncf-io\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.381636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-etc-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.381636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.381636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381625    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-kubernetes\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-tuned\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-multus-certs\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-run-netns\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-cni-netd\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovnkube-script-lib\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381820    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cnibin\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-system-cni-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.381903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381902    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-cni-multus\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381934    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-socket-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx68s\" (UniqueName: \"kubernetes.io/projected/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-kube-api-access-gx68s\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.381991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-sysctl-conf\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-host\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-host\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-cni-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382175    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c54da2ef-e717-478f-95b0-b57b158b8593-agent-certs\") pod \"konnectivity-agent-sm6jv\" (UID: \"c54da2ef-e717-478f-95b0-b57b158b8593\") " pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-systemd\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.382281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382239    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-cni-bin\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.382721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-env-overrides\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.382721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382312    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 15:38:09.382721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382603    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovnkube-config\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.382721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.380218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-var-lib-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.382721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382667    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-run-netns\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.382721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382703    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-systemd\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.383026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382739    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-cni-netd\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.383026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382816    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04b04807-15ac-4c14-996b-fc7456ca4621-kubelet-config\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.383026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-socket-dir\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.383026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.382956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.383219 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.383054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-modprobe-d\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.383219 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.383112    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-etc-openvswitch\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.383219 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.383188    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f829165-20e8-4f2b-b5d5-c01150e0c959-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.383365 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.383254    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-kubernetes\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.383452 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.383417    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovnkube-script-lib\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.387399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.386767    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45eb1a3c-ce14-4b93-96d3-77ee176b3614-etc-tuned\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.387399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.386965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f829165-20e8-4f2b-b5d5-c01150e0c959-ovn-node-metrics-cert\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.387399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.387359    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45eb1a3c-ce14-4b93-96d3-77ee176b3614-tmp\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.394605 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.394580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx68s\" (UniqueName: \"kubernetes.io/projected/1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7-kube-api-access-gx68s\") pod \"aws-ebs-csi-driver-node-rq958\" (UID: \"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.398982 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.398959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb6qs\" (UniqueName: \"kubernetes.io/projected/3ee2ac86-e86d-4ff0-9a76-24773f962f61-kube-api-access-nb6qs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.400929 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.400904    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:09.400929 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.400926    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:09.401099 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.400941    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:09.401099 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.401017    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:38:09.900998907 +0000 UTC m=+3.015848975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:09.403352 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.403321    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtqg\" (UniqueName: \"kubernetes.io/projected/c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7-kube-api-access-nbtqg\") pod \"node-ca-852hk\" (UID: \"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7\") " pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.403595 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.403562    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr4tj\" (UniqueName: \"kubernetes.io/projected/45eb1a3c-ce14-4b93-96d3-77ee176b3614-kube-api-access-qr4tj\") pod \"tuned-jkcsr\" (UID: \"45eb1a3c-ce14-4b93-96d3-77ee176b3614\") " pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.403962 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.403943    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpkmb\" (UniqueName: \"kubernetes.io/projected/6d4fff96-98b6-443e-a673-968187ab8f33-kube-api-access-dpkmb\") pod \"node-resolver-p8zm2\" (UID: \"6d4fff96-98b6-443e-a673-968187ab8f33\") " pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.405212 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.405190    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz8j6\" (UniqueName: \"kubernetes.io/projected/0f829165-20e8-4f2b-b5d5-c01150e0c959-kube-api-access-hz8j6\") pod \"ovnkube-node-ztv8w\" (UID: \"0f829165-20e8-4f2b-b5d5-c01150e0c959\") " pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.441524 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.441464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" event={"ID":"b30696e4d4a2a43878c66454fe445b18","Type":"ContainerStarted","Data":"a8b53342fe50241b15fb45fb92efb5410b95a5549dc77ae7adfd49a2c1126b43"}
Jul 20 15:38:09.442532 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.442506    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" event={"ID":"a14eb8e7fba09e08b93aa31ac7513801","Type":"ContainerStarted","Data":"673d404e17b1e7e199f437c5ca19b15b0eb9cd692ee42b5479990dc252752b9a"}
Jul 20 15:38:09.483405 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483366    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/699f20a3-4268-4a76-8547-9bca5ff9b9e6-iptables-alerter-script\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483413    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-cnibin\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483465    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-netns\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/699f20a3-4268-4a76-8547-9bca5ff9b9e6-host-slash\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-system-cni-dir\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-cnibin\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.483585 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483595    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-netns\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483600    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/699f20a3-4268-4a76-8547-9bca5ff9b9e6-host-slash\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-system-cni-dir\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483638    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483681    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snqpf\" (UniqueName: \"kubernetes.io/projected/c630dde8-7dd2-4f55-afa4-e9e50aff5624-kube-api-access-snqpf\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.483987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-k8s-cni-cncf-io\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.483999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-multus-certs\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484035    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-k8s-cni-cncf-io\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484038    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cnibin\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484076    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cnibin\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-system-cni-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484099    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/699f20a3-4268-4a76-8547-9bca5ff9b9e6-iptables-alerter-script\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-cni-multus\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484121    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-run-multus-certs\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-cni-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c54da2ef-e717-478f-95b0-b57b158b8593-agent-certs\") pod \"konnectivity-agent-sm6jv\" (UID: \"c54da2ef-e717-478f-95b0-b57b158b8593\") " pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484184    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-cni-bin\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484199    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-cni-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-system-cni-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484228    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cni-binary-copy\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-cni-bin\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-cni-multus\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.484317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484251    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-kubelet\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjlnc\" (UniqueName: \"kubernetes.io/projected/699f20a3-4268-4a76-8547-9bca5ff9b9e6-kube-api-access-fjlnc\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484307    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-host-var-lib-kubelet\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-os-release\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c54da2ef-e717-478f-95b0-b57b158b8593-konnectivity-ca\") pod \"konnectivity-agent-sm6jv\" (UID: \"c54da2ef-e717-478f-95b0-b57b158b8593\") " pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-os-release\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484417    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-conf-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484438    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c630dde8-7dd2-4f55-afa4-e9e50aff5624-os-release\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-daemon-config\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-etc-kubernetes\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-os-release\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484512    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-socket-dir-parent\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484538    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptk4x\" (UniqueName: \"kubernetes.io/projected/6e8af669-dcfb-45e1-a68b-1cf064190c96-kube-api-access-ptk4x\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e8af669-dcfb-45e1-a68b-1cf064190c96-cni-binary-copy\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-hostroot\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484625    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-etc-kubernetes\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484667    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-hostroot\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.485137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484676    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c630dde8-7dd2-4f55-afa4-e9e50aff5624-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.486045 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484726    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-conf-dir\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.486045 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.484767    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-socket-dir-parent\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.486045 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.485008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c54da2ef-e717-478f-95b0-b57b158b8593-konnectivity-ca\") pod \"konnectivity-agent-sm6jv\" (UID: \"c54da2ef-e717-478f-95b0-b57b158b8593\") " pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.486045 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.485024    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6e8af669-dcfb-45e1-a68b-1cf064190c96-multus-daemon-config\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.486045 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.485202    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e8af669-dcfb-45e1-a68b-1cf064190c96-cni-binary-copy\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.487206 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.487181    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c54da2ef-e717-478f-95b0-b57b158b8593-agent-certs\") pod \"konnectivity-agent-sm6jv\" (UID: \"c54da2ef-e717-478f-95b0-b57b158b8593\") " pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.494662 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.494598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snqpf\" (UniqueName: \"kubernetes.io/projected/c630dde8-7dd2-4f55-afa4-e9e50aff5624-kube-api-access-snqpf\") pod \"multus-additional-cni-plugins-7nz4v\" (UID: \"c630dde8-7dd2-4f55-afa4-e9e50aff5624\") " pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.496737 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.496712    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjlnc\" (UniqueName: \"kubernetes.io/projected/699f20a3-4268-4a76-8547-9bca5ff9b9e6-kube-api-access-fjlnc\") pod \"iptables-alerter-svfdf\" (UID: \"699f20a3-4268-4a76-8547-9bca5ff9b9e6\") " pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.496928 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.496912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptk4x\" (UniqueName: \"kubernetes.io/projected/6e8af669-dcfb-45e1-a68b-1cf064190c96-kube-api-access-ptk4x\") pod \"multus-2x69d\" (UID: \"6e8af669-dcfb-45e1-a68b-1cf064190c96\") " pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.570771 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.570733    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p8zm2"
Jul 20 15:38:09.583168 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.583145    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:09.592368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.592335    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-852hk"
Jul 20 15:38:09.599212 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.599190    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jkcsr"
Jul 20 15:38:09.606914 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.606883    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958"
Jul 20 15:38:09.614735 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.614715    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7nz4v"
Jul 20 15:38:09.619729 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.619710    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 15:38:09.622505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.622487    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-svfdf"
Jul 20 15:38:09.631264 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.631243    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2x69d"
Jul 20 15:38:09.636135 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.636115    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:09.887416 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.887383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:09.887610 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.887442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:09.887610 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.887559    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:09.887610 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.887572    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:09.887749 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.887640    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:10.887619336 +0000 UTC m=+4.002469405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:09.887749 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.887659    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:10.88765096 +0000 UTC m=+4.002501027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:09.988096 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:09.988056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:09.988287 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.988254    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:09.988287 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.988279    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:09.988396 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.988290    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:09.988396 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:09.988354    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:38:10.988337183 +0000 UTC m=+4.103187248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:10.321914 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.321874    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:33:09 +0000 UTC" deadline="2028-02-07 03:00:54.99357057 +0000 UTC"
Jul 20 15:38:10.321914 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.321909    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13595h22m44.67166598s"
Jul 20 15:38:10.371255 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:10.370866    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc630dde8_7dd2_4f55_afa4_e9e50aff5624.slice/crio-2d9a5d7fc0f30b6836a7cf9964e5e52c95adefd47179c9445d351b83a4421260 WatchSource:0}: Error finding container 2d9a5d7fc0f30b6836a7cf9964e5e52c95adefd47179c9445d351b83a4421260: Status 404 returned error can't find the container with id 2d9a5d7fc0f30b6836a7cf9964e5e52c95adefd47179c9445d351b83a4421260
Jul 20 15:38:10.374701 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:10.374674    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45eb1a3c_ce14_4b93_96d3_77ee176b3614.slice/crio-1749fb0aa931c55d22d5ed190b9d0547319d999fcae699f2a2f98bc0c7808936 WatchSource:0}: Error finding container 1749fb0aa931c55d22d5ed190b9d0547319d999fcae699f2a2f98bc0c7808936: Status 404 returned error can't find the container with id 1749fb0aa931c55d22d5ed190b9d0547319d999fcae699f2a2f98bc0c7808936
Jul 20 15:38:10.375439 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:10.375399    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4fff96_98b6_443e_a673_968187ab8f33.slice/crio-3d41aa98c5927c92770ec5d687e8f583498e685d5599e21f33a79e9a1a1370ee WatchSource:0}: Error finding container 3d41aa98c5927c92770ec5d687e8f583498e685d5599e21f33a79e9a1a1370ee: Status 404 returned error can't find the container with id 3d41aa98c5927c92770ec5d687e8f583498e685d5599e21f33a79e9a1a1370ee
Jul 20 15:38:10.377051 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:10.376495    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54da2ef_e717_478f_95b0_b57b158b8593.slice/crio-5ab0de44b19ed09aba6dcd4fee23a3a4b0b9a745ebc5f80d9ffaa597a7fb3d0f WatchSource:0}: Error finding container 5ab0de44b19ed09aba6dcd4fee23a3a4b0b9a745ebc5f80d9ffaa597a7fb3d0f: Status 404 returned error can't find the container with id 5ab0de44b19ed09aba6dcd4fee23a3a4b0b9a745ebc5f80d9ffaa597a7fb3d0f
Jul 20 15:38:10.378086 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:10.377797    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4abe2d1_0e5e_4056_a43f_9aeef59ad0c7.slice/crio-21e95c5b6e8ecddb70747d0b79e80d9e3b3b8195e2a5a6b85e2f85b110b9909f WatchSource:0}: Error finding container 21e95c5b6e8ecddb70747d0b79e80d9e3b3b8195e2a5a6b85e2f85b110b9909f: Status 404 returned error can't find the container with id 21e95c5b6e8ecddb70747d0b79e80d9e3b3b8195e2a5a6b85e2f85b110b9909f
Jul 20 15:38:10.379811 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:10.378803    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8af669_dcfb_45e1_a68b_1cf064190c96.slice/crio-169bddeb00584e699e980d7f1fce4810ef84717e920d6546d176ad8bc0a014f8 WatchSource:0}: Error finding container 169bddeb00584e699e980d7f1fce4810ef84717e920d6546d176ad8bc0a014f8: Status 404 returned error can't find the container with id 169bddeb00584e699e980d7f1fce4810ef84717e920d6546d176ad8bc0a014f8
Jul 20 15:38:10.437951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.437923    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:10.438092 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.437929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:10.438092 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.438044    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:10.438217 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.438107    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:10.445292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.445263    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-svfdf" event={"ID":"699f20a3-4268-4a76-8547-9bca5ff9b9e6","Type":"ContainerStarted","Data":"980869bf8313e6ae297fa550a4e58f9a30c5ca89278f0039374981ba1fedd4f2"}
Jul 20 15:38:10.446501 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.446479    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jkcsr" event={"ID":"45eb1a3c-ce14-4b93-96d3-77ee176b3614","Type":"ContainerStarted","Data":"1749fb0aa931c55d22d5ed190b9d0547319d999fcae699f2a2f98bc0c7808936"}
Jul 20 15:38:10.447531 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.447501    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerStarted","Data":"2d9a5d7fc0f30b6836a7cf9964e5e52c95adefd47179c9445d351b83a4421260"}
Jul 20 15:38:10.448644 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.448621    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958" event={"ID":"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7","Type":"ContainerStarted","Data":"7c6d261600318edb5e6493bb7dbc2740682782532a447c317b9d079287907863"}
Jul 20 15:38:10.449932 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.449910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2x69d" event={"ID":"6e8af669-dcfb-45e1-a68b-1cf064190c96","Type":"ContainerStarted","Data":"169bddeb00584e699e980d7f1fce4810ef84717e920d6546d176ad8bc0a014f8"}
Jul 20 15:38:10.450917 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.450892    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-852hk" event={"ID":"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7","Type":"ContainerStarted","Data":"21e95c5b6e8ecddb70747d0b79e80d9e3b3b8195e2a5a6b85e2f85b110b9909f"}
Jul 20 15:38:10.452337 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.452317    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sm6jv" event={"ID":"c54da2ef-e717-478f-95b0-b57b158b8593","Type":"ContainerStarted","Data":"5ab0de44b19ed09aba6dcd4fee23a3a4b0b9a745ebc5f80d9ffaa597a7fb3d0f"}
Jul 20 15:38:10.453337 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.453315    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p8zm2" event={"ID":"6d4fff96-98b6-443e-a673-968187ab8f33","Type":"ContainerStarted","Data":"3d41aa98c5927c92770ec5d687e8f583498e685d5599e21f33a79e9a1a1370ee"}
Jul 20 15:38:10.457314 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.457261    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"e21f9c1103a7181877ebacd1053e9099932fea8cb495ad8e65b45aadacf2ec7c"}
Jul 20 15:38:10.894224 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.893914    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:10.894385 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.894235    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:10.894442 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.894409    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:10.894494 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.894471    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:12.894452475 +0000 UTC m=+6.009302543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:10.894916 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.894895    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:10.895027 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.894951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:12.894935833 +0000 UTC m=+6.009785899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:10.994778 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:10.994737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:10.994974 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.994928    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:10.994974 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.994948    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:10.994974 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.994961    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:10.995137 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:10.995022    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:38:12.995004742 +0000 UTC m=+6.109854816 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:11.322526 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.322443    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 15:33:09 +0000 UTC" deadline="2028-03-14 10:20:47.153740929 +0000 UTC"
Jul 20 15:38:11.322526 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.322509    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14466h42m35.831236178s"
Jul 20 15:38:11.437924 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.437889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:11.438117 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:11.438044    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:11.476965 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.476929    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" event={"ID":"b30696e4d4a2a43878c66454fe445b18","Type":"ContainerStarted","Data":"5e9a2836157173bc7769aaeada6f7fb739aac142e8b7832b79b5e2039f5692f7"}
Jul 20 15:38:11.484897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.484244    2569 generic.go:356] "Generic (PLEG): container finished" podID="a14eb8e7fba09e08b93aa31ac7513801" containerID="1fee1bff115e275a7766a07d47df8d2de351ec4fb99c4ffdd9f7c76c5066278c" exitCode=0
Jul 20 15:38:11.484897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.484299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" event={"ID":"a14eb8e7fba09e08b93aa31ac7513801","Type":"ContainerDied","Data":"1fee1bff115e275a7766a07d47df8d2de351ec4fb99c4ffdd9f7c76c5066278c"}
Jul 20 15:38:11.496860 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:11.496285    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-8.ec2.internal" podStartSLOduration=3.496263875 podStartE2EDuration="3.496263875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:11.496201868 +0000 UTC m=+4.611051977" watchObservedRunningTime="2026-07-20 15:38:11.496263875 +0000 UTC m=+4.611113962"
Jul 20 15:38:12.437998 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:12.437969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:12.438523 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:12.438094    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:12.438523 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:12.438453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:12.438706 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:12.438551    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:12.496508 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:12.496426    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" event={"ID":"a14eb8e7fba09e08b93aa31ac7513801","Type":"ContainerStarted","Data":"dd10f38ba741857617b884f64a547b5855fe0246a60696b456a6e36e93898771"}
Jul 20 15:38:12.911643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:12.911601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:12.911858 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:12.911700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:12.911922 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:12.911855    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:12.911922 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:12.911920    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:16.911901265 +0000 UTC m=+10.026751341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:12.912337 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:12.912319    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:12.912433 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:12.912369    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:16.912353134 +0000 UTC m=+10.027203202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:13.012931 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:13.012886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:13.013178 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:13.013129    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:13.013178 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:13.013151    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:13.013178 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:13.013164    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:13.013358 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:13.013229    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:38:17.013211547 +0000 UTC m=+10.128061626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:13.442951 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:13.442887    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:13.443400 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:13.443114    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:14.437997 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:14.437959    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:14.438191 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:14.438093    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:14.438530 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:14.438508    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:14.438643 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:14.438621    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:15.441336 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:15.441293    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:15.441732 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:15.441435    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:16.438302 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:16.438268    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:16.438477 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:16.438280    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:16.438477 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:16.438394    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:16.438477 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:16.438442    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:16.947078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:16.947035    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:16.947547 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:16.947098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:16.947547 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:16.947199    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:16.947547 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:16.947203    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:16.947547 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:16.947251    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:24.947237202 +0000 UTC m=+18.062087269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:16.947547 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:16.947276    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:24.947258 +0000 UTC m=+18.062108064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:17.047993 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:17.047951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:17.048188 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:17.048153    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:17.048188 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:17.048181    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:17.048298 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:17.048194    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:17.048298 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:17.048258    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:38:25.048239609 +0000 UTC m=+18.163089686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:17.441432 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:17.439811    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:17.441432 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:17.439995    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:18.438423 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:18.438385    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:18.438893 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:18.438406    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:18.438893 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:18.438531    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:18.438893 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:18.438584    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:19.438436 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:19.438401    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:19.438922 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:19.438558    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:20.438167 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:20.438135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:20.438363 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:20.438266    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:20.438363 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:20.438311    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:20.438480 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:20.438423    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:21.437674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:21.437640    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:21.437870 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:21.437768    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:22.437688 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:22.437650    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:22.438211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:22.437665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:22.438211 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:22.437767    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:22.438211 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:22.437865    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:23.438262 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:23.438225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:23.438695 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:23.438368    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:24.438297 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:24.438259    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:24.438825 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:24.438384    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:24.438825 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:24.438268    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:24.438962 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:24.438859    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:25.008635 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:25.008598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:25.008818 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:25.008666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:25.008818 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.008756    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:25.008818 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.008781    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:25.008968 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.008850    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:41.008812323 +0000 UTC m=+34.123662400 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:25.008968 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.008873    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:38:41.008860656 +0000 UTC m=+34.123710726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:25.109694 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:25.109614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:25.109852 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.109748    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:25.109852 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.109763    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:25.109852 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.109772    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:25.109852 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.109823    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:38:41.109808711 +0000 UTC m=+34.224658791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:25.438478 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:25.438399    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:25.438906 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:25.438523    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:26.437671 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:26.437636    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:26.437863 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:26.437642    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:26.437911 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:26.437860    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:26.437911 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:26.437735    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:27.441165 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:27.441134    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:27.441616 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:27.441265    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:28.437684 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:28.437648    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:28.437876 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:28.437648    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:28.437876 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:28.437766    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:28.437876 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:28.437846    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:29.437408 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.437382    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:29.437752 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:29.437510    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:29.532664 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.532455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2x69d" event={"ID":"6e8af669-dcfb-45e1-a68b-1cf064190c96","Type":"ContainerStarted","Data":"42f2910d707ce239f6c1c88da8253ae94428d7a007804771b7511f793ced7504"}
Jul 20 15:38:29.533956 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.533893    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-852hk" event={"ID":"c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7","Type":"ContainerStarted","Data":"4976208f39265345abf820c8f2c41c196784acb62fc0e3b4f8bf2b69635f0f2d"}
Jul 20 15:38:29.535358 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.535320    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sm6jv" event={"ID":"c54da2ef-e717-478f-95b0-b57b158b8593","Type":"ContainerStarted","Data":"9c69ffb9a82f7b056da03d5d9b7e5bc69ff8b67af86f5a4986513eab0ec3b69f"}
Jul 20 15:38:29.536657 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.536634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p8zm2" event={"ID":"6d4fff96-98b6-443e-a673-968187ab8f33","Type":"ContainerStarted","Data":"5a041eebf6b1c0ed89c85f37c722cecd44813a1e8c119c4bc78d32c80e220d8e"}
Jul 20 15:38:29.538121 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.538102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jkcsr" event={"ID":"45eb1a3c-ce14-4b93-96d3-77ee176b3614","Type":"ContainerStarted","Data":"92194570c64c88d8bb63a7d005ba18ed1a7e45e8bc50e42d7b3d8e146497d03b"}
Jul 20 15:38:29.539494 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.539474    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerStarted","Data":"1208534b8037cc3a0ac9704d0394b0193b7e11feaf01d4afe848e775e0ece30b"}
Jul 20 15:38:29.549495 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.549455    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-8.ec2.internal" podStartSLOduration=21.549442372 podStartE2EDuration="21.549442372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:12.524147181 +0000 UTC m=+5.638997269" watchObservedRunningTime="2026-07-20 15:38:29.549442372 +0000 UTC m=+22.664292457"
Jul 20 15:38:29.549913 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.549886    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-852hk" podStartSLOduration=3.6390596889999998 podStartE2EDuration="22.549881165s" totalImagesPullingTime="18.910821476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:29.549166571 +0000 UTC m=+22.664016655" watchObservedRunningTime="2026-07-20 15:38:29.549881165 +0000 UTC m=+22.664731251"
Jul 20 15:38:29.608062 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.608011    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sm6jv" podStartSLOduration=3.697627415 podStartE2EDuration="22.607994244s" totalImagesPullingTime="18.910366829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:29.589918692 +0000 UTC m=+22.704768776" watchObservedRunningTime="2026-07-20 15:38:29.607994244 +0000 UTC m=+22.722844328"
Jul 20 15:38:29.626665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.626620    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jkcsr" podStartSLOduration=3.712343743 podStartE2EDuration="22.626602278s" totalImagesPullingTime="18.914258535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:29.626021221 +0000 UTC m=+22.740871305" watchObservedRunningTime="2026-07-20 15:38:29.626602278 +0000 UTC m=+22.741452363"
Jul 20 15:38:29.626816 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:29.626722    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p8zm2" podStartSLOduration=3.713616075 podStartE2EDuration="22.626714963s" totalImagesPullingTime="18.913098888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:29.608266934 +0000 UTC m=+22.723117018" watchObservedRunningTime="2026-07-20 15:38:29.626714963 +0000 UTC m=+22.741565049"
Jul 20 15:38:30.438201 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.437946    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:30.438884 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.437946    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:30.438884 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:30.438249    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:30.438884 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:30.438289    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:30.543234 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.543207    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"ba7c25a0c8e1225aa6247a846cc9c3939250295ad04ac2b0c30e65ac7b74b6b2"}
Jul 20 15:38:30.543355 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.543282    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"8914ff427807cb980a72971854af36bb7e513d59e6d4219c57e5d20de0c50e99"}
Jul 20 15:38:30.543355 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.543315    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"841e48fb1da65aa0449c08e9fa0d477eaaab65f14674422977f18504d19a627e"}
Jul 20 15:38:30.543437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.543352    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"f14ebbe1b0402e882fbbf7dfce8efbe3e2bd271c39af09e6a4e9ebb56ed02f89"}
Jul 20 15:38:30.544482 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.544462    2569 generic.go:356] "Generic (PLEG): container finished" podID="c630dde8-7dd2-4f55-afa4-e9e50aff5624" containerID="1208534b8037cc3a0ac9704d0394b0193b7e11feaf01d4afe848e775e0ece30b" exitCode=0
Jul 20 15:38:30.544547 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.544522    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerDied","Data":"1208534b8037cc3a0ac9704d0394b0193b7e11feaf01d4afe848e775e0ece30b"}
Jul 20 15:38:30.545935 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.545914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958" event={"ID":"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7","Type":"ContainerStarted","Data":"fe36f2cd15a7112de8f50221809a5e36c980c19d060e6091f13bf488dfb6b3b2"}
Jul 20 15:38:30.590139 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.590093    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2x69d" podStartSLOduration=4.63796699 podStartE2EDuration="23.590075695s" totalImagesPullingTime="18.952108705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:30.589661121 +0000 UTC m=+23.704511205" watchObservedRunningTime="2026-07-20 15:38:30.590075695 +0000 UTC m=+23.704925779"
Jul 20 15:38:30.864036 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:30.864008    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 15:38:31.337312 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.337164    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T15:38:30.864029184Z","UUID":"2454d409-89c2-4e2a-9671-64ba028084e4","Handler":null,"Name":"","Endpoint":""}
Jul 20 15:38:31.339033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.339008    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 15:38:31.339178 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.339052    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 15:38:31.438281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.438181    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:31.438763 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:31.438363    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:31.551563 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.551525    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"3740771850d4896d11669fc1e2c361c5e43d8a3700c4618f19d4a54838c42cad"}
Jul 20 15:38:31.551741 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.551617    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"da1a3df94d45e620a017dd0824b7d8b448c050187d3c41c81ade03e18d6e4b1e"}
Jul 20 15:38:31.553090 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.553056    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-svfdf" event={"ID":"699f20a3-4268-4a76-8547-9bca5ff9b9e6","Type":"ContainerStarted","Data":"c9fcb1fe629c75b50731c17f103b9a3a5e222f98bca0be1eaf4376ab108cd80c"}
Jul 20 15:38:31.555164 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.555139    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958" event={"ID":"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7","Type":"ContainerStarted","Data":"00973c947347d162ddf919afed054ceada090ca4534ac570ed85ebd47006fea3"}
Jul 20 15:38:31.580274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:31.580219    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-svfdf" podStartSLOduration=5.654939373 podStartE2EDuration="24.580204284s" totalImagesPullingTime="18.925264911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:31.579629535 +0000 UTC m=+24.694479624" watchObservedRunningTime="2026-07-20 15:38:31.580204284 +0000 UTC m=+24.695054369"
Jul 20 15:38:32.437574 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.437548    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:32.437574 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.437573    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:32.437826 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:32.437667    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:32.437826 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:32.437803    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:32.474245 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.474217    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:32.475047 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.475027    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:32.560890 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.560851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958" event={"ID":"1d6f2bd0-5285-4270-9cfd-0855cb5ea7e7","Type":"ContainerStarted","Data":"61b8e77e62d6087f8958e16e30e3ed4d41bc8a1c9fe5de67901f01f3a5625653"}
Jul 20 15:38:32.561252 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.561225    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:32.562057 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.562036    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sm6jv"
Jul 20 15:38:32.598621 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:32.598534    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rq958" podStartSLOduration=3.99775132 podStartE2EDuration="25.598516942s" totalImagesPullingTime="21.600765622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:32.582498097 +0000 UTC m=+25.697348182" watchObservedRunningTime="2026-07-20 15:38:32.598516942 +0000 UTC m=+25.713367027"
Jul 20 15:38:33.437722 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:33.437495    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:33.438059 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:33.437826    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:33.565977 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:33.565943    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"2066c9d09b1d0a232c496a24bfea70915b7271d40b2aca7fdf5aa7d73eabf827"}
Jul 20 15:38:34.437646 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:34.437601    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:34.437956 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:34.437726    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:34.437956 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:34.437611    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:34.437956 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:34.437889    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:35.438595 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.438387    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:35.439481 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:35.438729    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:35.571630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.571595    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerStarted","Data":"f09e00611669d47606d947608faafaba5bee6a4724fdbefdfa86be843f666bd3"}
Jul 20 15:38:35.574759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.574733    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" event={"ID":"0f829165-20e8-4f2b-b5d5-c01150e0c959","Type":"ContainerStarted","Data":"f3cc2fbe4aebfefb2bca46741fca0dc87b15f8385a441878a9d61479c4ecccc0"}
Jul 20 15:38:35.575073 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.575056    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:35.575140 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.575125    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:35.575264 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.575174    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:35.590658 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.590632    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:35.590778 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.590769    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:38:35.624991 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:35.624943    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w" podStartSLOduration=9.087616094 podStartE2EDuration="28.624927821s" totalImagesPullingTime="19.537311727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:35.624454118 +0000 UTC m=+28.739304203" watchObservedRunningTime="2026-07-20 15:38:35.624927821 +0000 UTC m=+28.739777906"
Jul 20 15:38:36.438181 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:36.438149    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:36.438500 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:36.438150    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:36.438500 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:36.438284    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:36.438500 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:36.438349    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:36.578554 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:36.578523    2569 generic.go:356] "Generic (PLEG): container finished" podID="c630dde8-7dd2-4f55-afa4-e9e50aff5624" containerID="f09e00611669d47606d947608faafaba5bee6a4724fdbefdfa86be843f666bd3" exitCode=0
Jul 20 15:38:36.578795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:36.578622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerDied","Data":"f09e00611669d47606d947608faafaba5bee6a4724fdbefdfa86be843f666bd3"}
Jul 20 15:38:37.440294 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:37.440258    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:37.440698 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:37.440407    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:37.583763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:37.583729    2569 generic.go:356] "Generic (PLEG): container finished" podID="c630dde8-7dd2-4f55-afa4-e9e50aff5624" containerID="caa3f14fbb58a05c0d538e80c8aa6e1398b74c4eeaadbb594f8c70ddc549caab" exitCode=0
Jul 20 15:38:37.583922 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:37.583779    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerDied","Data":"caa3f14fbb58a05c0d538e80c8aa6e1398b74c4eeaadbb594f8c70ddc549caab"}
Jul 20 15:38:38.025924 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:38.025813    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rflsh"]
Jul 20 15:38:38.026073 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:38.025980    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:38.026131 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:38.026069    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:38.026407 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:38.026390    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-424gk"]
Jul 20 15:38:38.026480 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:38.026470    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:38.026554 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:38.026538    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:38.029101 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:38.029078    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkt82"]
Jul 20 15:38:38.029229 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:38.029149    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:38.029276 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:38.029224    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:39.438292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:39.438259    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:39.438292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:39.438281    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:39.438292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:39.438269    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:39.438799 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:39.438373    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:39.438799 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:39.438449    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:39.438799 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:39.438496    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:39.591219 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:39.591140    2569 generic.go:356] "Generic (PLEG): container finished" podID="c630dde8-7dd2-4f55-afa4-e9e50aff5624" containerID="5fba04293397b2da70b7a0a6a486ac2d9f5e3b5e6e6e75d71cfc088adfd31799" exitCode=0
Jul 20 15:38:39.591219 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:39.591193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerDied","Data":"5fba04293397b2da70b7a0a6a486ac2d9f5e3b5e6e6e75d71cfc088adfd31799"}
Jul 20 15:38:41.018534 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:41.018499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:41.019015 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:41.018554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:41.019015 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.018661    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:41.019015 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.018661    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:41.019015 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.018719    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs podName:3ee2ac86-e86d-4ff0-9a76-24773f962f61 nodeName:}" failed. No retries permitted until 2026-07-20 15:39:13.018703118 +0000 UTC m=+66.133553184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs") pod "network-metrics-daemon-bkt82" (UID: "3ee2ac86-e86d-4ff0-9a76-24773f962f61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 15:38:41.019015 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.018779    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret podName:04b04807-15ac-4c14-996b-fc7456ca4621 nodeName:}" failed. No retries permitted until 2026-07-20 15:39:13.018757365 +0000 UTC m=+66.133607429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret") pod "global-pull-secret-syncer-rflsh" (UID: "04b04807-15ac-4c14-996b-fc7456ca4621") : object "kube-system"/"original-pull-secret" not registered
Jul 20 15:38:41.119485 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:41.119451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:41.119654 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.119603    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 15:38:41.119654 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.119621    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 15:38:41.119654 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.119631    2569 projected.go:196] Error preparing data for projected volume kube-api-access-w7hhs for pod openshift-network-diagnostics/network-check-target-424gk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:41.119770 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.119680    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs podName:54319d6a-7d6d-4678-994b-bd4566eb35db nodeName:}" failed. No retries permitted until 2026-07-20 15:39:13.119665732 +0000 UTC m=+66.234515799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w7hhs" (UniqueName: "kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs") pod "network-check-target-424gk" (UID: "54319d6a-7d6d-4678-994b-bd4566eb35db") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 15:38:41.437780 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:41.437732    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:41.437780 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:41.437747    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:41.437780 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:41.437747    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:41.438067 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.437886    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rflsh" podUID="04b04807-15ac-4c14-996b-fc7456ca4621"
Jul 20 15:38:41.438269 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.438233    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-424gk" podUID="54319d6a-7d6d-4678-994b-bd4566eb35db"
Jul 20 15:38:41.438401 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:41.438332    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bkt82" podUID="3ee2ac86-e86d-4ff0-9a76-24773f962f61"
Jul 20 15:38:43.196874 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.196776    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-8.ec2.internal" event="NodeReady"
Jul 20 15:38:43.197465 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.196965    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 15:38:43.262207 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.262175    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lksdr"]
Jul 20 15:38:43.264663 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.264644    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.266789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.266743    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vcqv"]
Jul 20 15:38:43.267371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.267349    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 15:38:43.267371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.267370    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 15:38:43.267638 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.267614    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 15:38:43.267723 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.267619    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g5zjc\""
Jul 20 15:38:43.268605 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.268590    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"]
Jul 20 15:38:43.268730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.268713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.270685 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.270662    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vvsdk\""
Jul 20 15:38:43.270939 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.270921    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.273763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.273716    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 15:38:43.273763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.273729    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 15:38:43.273763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.273736    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmwcj\""
Jul 20 15:38:43.274060 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.274043    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 15:38:43.274235 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.274222    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 15:38:43.276301 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.276211    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 15:38:43.280721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.280701    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 15:38:43.290251 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.290227    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vcqv"]
Jul 20 15:38:43.291021 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.291001    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lksdr"]
Jul 20 15:38:43.308651 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.308617    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"]
Jul 20 15:38:43.334232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-trusted-ca\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334381 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.334381 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334280    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tv4x\" (UniqueName: \"kubernetes.io/projected/0ae2a2c0-53df-4000-b770-5292e22a24e7-kube-api-access-7tv4x\") pod \"ingress-canary-lksdr\" (UID: \"0ae2a2c0-53df-4000-b770-5292e22a24e7\") " pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.334381 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-ca-trust-extracted\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334431    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-certificates\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8872159f-72c6-44e9-9c76-50488fcbeb3e-config-volume\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.334522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8872159f-72c6-44e9-9c76-50488fcbeb3e-tmp-dir\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.334693 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334538    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-image-registry-private-configuration\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334693 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334572    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhbs9\" (UniqueName: \"kubernetes.io/projected/8872159f-72c6-44e9-9c76-50488fcbeb3e-kube-api-access-lhbs9\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.334693 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334594    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ae2a2c0-53df-4000-b770-5292e22a24e7-cert\") pod \"ingress-canary-lksdr\" (UID: \"0ae2a2c0-53df-4000-b770-5292e22a24e7\") " pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.334693 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334616    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-installation-pull-secrets\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334693 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334644    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htpbx\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-kube-api-access-htpbx\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.334693 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.334666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-bound-sa-token\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.435542 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.435542 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435539    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tv4x\" (UniqueName: \"kubernetes.io/projected/0ae2a2c0-53df-4000-b770-5292e22a24e7-kube-api-access-7tv4x\") pod \"ingress-canary-lksdr\" (UID: \"0ae2a2c0-53df-4000-b770-5292e22a24e7\") " pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-ca-trust-extracted\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-certificates\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8872159f-72c6-44e9-9c76-50488fcbeb3e-config-volume\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.435688    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.435707    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdd9f6f4d-lljcx: secret "image-registry-tls" not found
Jul 20 15:38:43.435777 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.435766    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls podName:9bd54b6e-7d99-4042-8192-02b3fcc18e9f nodeName:}" failed. No retries permitted until 2026-07-20 15:38:43.935747192 +0000 UTC m=+37.050597263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls") pod "image-registry-5bdd9f6f4d-lljcx" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f") : secret "image-registry-tls" not found
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8872159f-72c6-44e9-9c76-50488fcbeb3e-tmp-dir\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435945    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-image-registry-private-configuration\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.435980    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhbs9\" (UniqueName: \"kubernetes.io/projected/8872159f-72c6-44e9-9c76-50488fcbeb3e-kube-api-access-lhbs9\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ae2a2c0-53df-4000-b770-5292e22a24e7-cert\") pod \"ingress-canary-lksdr\" (UID: \"0ae2a2c0-53df-4000-b770-5292e22a24e7\") " pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436028    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-installation-pull-secrets\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436038    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8872159f-72c6-44e9-9c76-50488fcbeb3e-tmp-dir\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htpbx\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-kube-api-access-htpbx\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436085    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-bound-sa-token\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436110    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-trusted-ca\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436627 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-certificates\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436627 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.435691    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:38:43.436627 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.436486    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls podName:8872159f-72c6-44e9-9c76-50488fcbeb3e nodeName:}" failed. No retries permitted until 2026-07-20 15:38:43.936461951 +0000 UTC m=+37.051312031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls") pod "dns-default-7vcqv" (UID: "8872159f-72c6-44e9-9c76-50488fcbeb3e") : secret "dns-default-metrics-tls" not found
Jul 20 15:38:43.436627 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436589    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-ca-trust-extracted\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.436627 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436611    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8872159f-72c6-44e9-9c76-50488fcbeb3e-config-volume\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.437019 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.436991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-trusted-ca\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.438076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.437947    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:38:43.438457 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.438285    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:38:43.438457 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.438418    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441014    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441042    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441067    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-installation-pull-secrets\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441090    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ae2a2c0-53df-4000-b770-5292e22a24e7-cert\") pod \"ingress-canary-lksdr\" (UID: \"0ae2a2c0-53df-4000-b770-5292e22a24e7\") " pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441090    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-image-registry-private-configuration\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.441163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441134    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 15:38:43.441560 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441174    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bmp9c\""
Jul 20 15:38:43.441560 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.441417    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdf5b\""
Jul 20 15:38:43.450015 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.449960    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htpbx\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-kube-api-access-htpbx\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.450183 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.450163    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-bound-sa-token\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.450964 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.450947    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhbs9\" (UniqueName: \"kubernetes.io/projected/8872159f-72c6-44e9-9c76-50488fcbeb3e-kube-api-access-lhbs9\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.451380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.451362    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tv4x\" (UniqueName: \"kubernetes.io/projected/0ae2a2c0-53df-4000-b770-5292e22a24e7-kube-api-access-7tv4x\") pod \"ingress-canary-lksdr\" (UID: \"0ae2a2c0-53df-4000-b770-5292e22a24e7\") " pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.578848 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.578793    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lksdr"
Jul 20 15:38:43.940974 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.940881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:43.940974 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:43.940924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:43.941200 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.941055    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:38:43.941200 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.941071    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdd9f6f4d-lljcx: secret "image-registry-tls" not found
Jul 20 15:38:43.941200 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.941070    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:38:43.941200 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.941148    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls podName:8872159f-72c6-44e9-9c76-50488fcbeb3e nodeName:}" failed. No retries permitted until 2026-07-20 15:38:44.94112619 +0000 UTC m=+38.055976255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls") pod "dns-default-7vcqv" (UID: "8872159f-72c6-44e9-9c76-50488fcbeb3e") : secret "dns-default-metrics-tls" not found
Jul 20 15:38:43.941200 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:43.941173    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls podName:9bd54b6e-7d99-4042-8192-02b3fcc18e9f nodeName:}" failed. No retries permitted until 2026-07-20 15:38:44.94116038 +0000 UTC m=+38.056010485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls") pod "image-registry-5bdd9f6f4d-lljcx" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f") : secret "image-registry-tls" not found
Jul 20 15:38:44.000796 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:44.000535    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lksdr"]
Jul 20 15:38:44.003758 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:44.003731    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae2a2c0_53df_4000_b770_5292e22a24e7.slice/crio-533b501e527f978b74496baed8aa9097c833d510561503cbc05477e29fe50920 WatchSource:0}: Error finding container 533b501e527f978b74496baed8aa9097c833d510561503cbc05477e29fe50920: Status 404 returned error can't find the container with id 533b501e527f978b74496baed8aa9097c833d510561503cbc05477e29fe50920
Jul 20 15:38:44.606267 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:44.606223    2569 generic.go:356] "Generic (PLEG): container finished" podID="c630dde8-7dd2-4f55-afa4-e9e50aff5624" containerID="11410121d3bb4b86e241edc13470c785c1e131ce749f4368b3d445b32e9799b3" exitCode=0
Jul 20 15:38:44.607012 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:44.606307    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerDied","Data":"11410121d3bb4b86e241edc13470c785c1e131ce749f4368b3d445b32e9799b3"}
Jul 20 15:38:44.607739 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:44.607710    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lksdr" event={"ID":"0ae2a2c0-53df-4000-b770-5292e22a24e7","Type":"ContainerStarted","Data":"533b501e527f978b74496baed8aa9097c833d510561503cbc05477e29fe50920"}
Jul 20 15:38:44.949156 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:44.949074    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:44.949156 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:44.949125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:44.949372 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:44.949252    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:38:44.949372 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:44.949286    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:38:44.949372 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:44.949299    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdd9f6f4d-lljcx: secret "image-registry-tls" not found
Jul 20 15:38:44.949372 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:44.949334    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls podName:8872159f-72c6-44e9-9c76-50488fcbeb3e nodeName:}" failed. No retries permitted until 2026-07-20 15:38:46.949312389 +0000 UTC m=+40.064162454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls") pod "dns-default-7vcqv" (UID: "8872159f-72c6-44e9-9c76-50488fcbeb3e") : secret "dns-default-metrics-tls" not found
Jul 20 15:38:44.949372 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:44.949353    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls podName:9bd54b6e-7d99-4042-8192-02b3fcc18e9f nodeName:}" failed. No retries permitted until 2026-07-20 15:38:46.949343479 +0000 UTC m=+40.064193548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls") pod "image-registry-5bdd9f6f4d-lljcx" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f") : secret "image-registry-tls" not found
Jul 20 15:38:45.613719 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:45.613687    2569 generic.go:356] "Generic (PLEG): container finished" podID="c630dde8-7dd2-4f55-afa4-e9e50aff5624" containerID="dab0ce0524fe96e1eb02b6f17380fb48c2700a6dce3188dfaf48e205e6aea3d0" exitCode=0
Jul 20 15:38:45.614267 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:45.613747    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerDied","Data":"dab0ce0524fe96e1eb02b6f17380fb48c2700a6dce3188dfaf48e205e6aea3d0"}
Jul 20 15:38:46.619757 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:46.619570    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" event={"ID":"c630dde8-7dd2-4f55-afa4-e9e50aff5624","Type":"ContainerStarted","Data":"d4a0dc14e1eed1d629913e29c13a60cb2936950f48dd92fc982ed9651b647b5b"}
Jul 20 15:38:46.647634 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:46.647566    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7nz4v" podStartSLOduration=9.386326877 podStartE2EDuration="39.647551009s" totalImagesPullingTime="30.261224132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:46.64578648 +0000 UTC m=+39.760636578" watchObservedRunningTime="2026-07-20 15:38:46.647551009 +0000 UTC m=+39.762401094"
Jul 20 15:38:46.964741 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:46.964653    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:46.964741 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:46.964699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:46.964928 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:46.964817    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:38:46.964928 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:46.964828    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdd9f6f4d-lljcx: secret "image-registry-tls" not found
Jul 20 15:38:46.964928 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:46.964816    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:38:46.964928 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:46.964906    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls podName:9bd54b6e-7d99-4042-8192-02b3fcc18e9f nodeName:}" failed. No retries permitted until 2026-07-20 15:38:50.964893424 +0000 UTC m=+44.079743487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls") pod "image-registry-5bdd9f6f4d-lljcx" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f") : secret "image-registry-tls" not found
Jul 20 15:38:46.964928 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:46.964920    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls podName:8872159f-72c6-44e9-9c76-50488fcbeb3e nodeName:}" failed. No retries permitted until 2026-07-20 15:38:50.96491432 +0000 UTC m=+44.079764382 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls") pod "dns-default-7vcqv" (UID: "8872159f-72c6-44e9-9c76-50488fcbeb3e") : secret "dns-default-metrics-tls" not found
Jul 20 15:38:47.623897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:47.623795    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lksdr" event={"ID":"0ae2a2c0-53df-4000-b770-5292e22a24e7","Type":"ContainerStarted","Data":"ff42c63ade929b4cddb7ca96f8d53d75b8e8f0725ad22a67575c9741dfa0ff0e"}
Jul 20 15:38:47.650049 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:47.649998    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lksdr" podStartSLOduration=2.138723981 podStartE2EDuration="4.649979797s" totalImagesPullingTime="2.511255816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:47.649374534 +0000 UTC m=+40.764224620" watchObservedRunningTime="2026-07-20 15:38:47.649979797 +0000 UTC m=+40.764829908"
Jul 20 15:38:49.731801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.731766    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-79wps"]
Jul 20 15:38:49.764286 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.764255    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79wps"]
Jul 20 15:38:49.764441 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.764363    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.766576 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.766551    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 15:38:49.766776 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.766759    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 15:38:49.767038 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.767019    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 15:38:49.767120 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.767017    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 15:38:49.767170 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.767026    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n6sjt\""
Jul 20 15:38:49.887669 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.887632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.887669 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.887668    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.887893 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.887726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f749663d-097d-4f09-89e3-3ad02eb02f6d-crio-socket\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.887893 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.887774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8ww\" (UniqueName: \"kubernetes.io/projected/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-api-access-wb8ww\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.887893 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.887827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f749663d-097d-4f09-89e3-3ad02eb02f6d-data-volume\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989186 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989117    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f749663d-097d-4f09-89e3-3ad02eb02f6d-crio-socket\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989186 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8ww\" (UniqueName: \"kubernetes.io/projected/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-api-access-wb8ww\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989329 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f749663d-097d-4f09-89e3-3ad02eb02f6d-data-volume\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989329 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989329 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989266    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989476 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f749663d-097d-4f09-89e3-3ad02eb02f6d-crio-socket\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:49.989476 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:49.989380    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:38:49.989476 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:49.989444    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:50.489427431 +0000 UTC m=+43.604277493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : configmap "kube-rbac-proxy" not found
Jul 20 15:38:49.989476 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:49.989382    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:49.989620 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:49.989503    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:50.489491161 +0000 UTC m=+43.604341235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:49.989620 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:49.989556    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f749663d-097d-4f09-89e3-3ad02eb02f6d-data-volume\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:50.001737 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:50.001701    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8ww\" (UniqueName: \"kubernetes.io/projected/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-api-access-wb8ww\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:50.492607 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:50.492566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:50.492607 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:50.492605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:50.492809 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.492660    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:38:50.492809 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.492704    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:50.492809 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.492735    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:51.492717274 +0000 UTC m=+44.607567363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : configmap "kube-rbac-proxy" not found
Jul 20 15:38:50.492809 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.492750    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:51.492744414 +0000 UTC m=+44.607594478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:50.997435 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:50.997391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:50.997435 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:50.997435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:50.998010 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.997574    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 15:38:50.998010 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.997617    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 15:38:50.998010 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.997628    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bdd9f6f4d-lljcx: secret "image-registry-tls" not found
Jul 20 15:38:50.998010 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.997661    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls podName:8872159f-72c6-44e9-9c76-50488fcbeb3e nodeName:}" failed. No retries permitted until 2026-07-20 15:38:58.99764028 +0000 UTC m=+52.112490356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls") pod "dns-default-7vcqv" (UID: "8872159f-72c6-44e9-9c76-50488fcbeb3e") : secret "dns-default-metrics-tls" not found
Jul 20 15:38:50.998010 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:50.997685    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls podName:9bd54b6e-7d99-4042-8192-02b3fcc18e9f nodeName:}" failed. No retries permitted until 2026-07-20 15:38:58.997673854 +0000 UTC m=+52.112523922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls") pod "image-registry-5bdd9f6f4d-lljcx" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f") : secret "image-registry-tls" not found
Jul 20 15:38:51.214153 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.214118    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-cnzf2"]
Jul 20 15:38:51.236773 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.236742    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-cnzf2"]
Jul 20 15:38:51.236936 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.236879    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.239120 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.239094    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 15:38:51.239252 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.239156    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 15:38:51.239332 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.239253    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 15:38:51.239648 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.239623    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lrg8m\""
Jul 20 15:38:51.239648 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.239628    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 15:38:51.399561 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.399524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10b7375f-1a08-4d29-9d02-5b4066c15edd-signing-key\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.399561 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.399566    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfm6j\" (UniqueName: \"kubernetes.io/projected/10b7375f-1a08-4d29-9d02-5b4066c15edd-kube-api-access-vfm6j\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.399814 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.399596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10b7375f-1a08-4d29-9d02-5b4066c15edd-signing-cabundle\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.500465 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.500430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfm6j\" (UniqueName: \"kubernetes.io/projected/10b7375f-1a08-4d29-9d02-5b4066c15edd-kube-api-access-vfm6j\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.500628 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.500476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10b7375f-1a08-4d29-9d02-5b4066c15edd-signing-cabundle\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.500628 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.500524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:51.500628 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.500560    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:51.500759 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:51.500639    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:51.500759 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:51.500639    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:38:51.500759 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:51.500681    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:53.500668059 +0000 UTC m=+46.615518121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:51.500759 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:51.500702    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:53.500686612 +0000 UTC m=+46.615536692 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : configmap "kube-rbac-proxy" not found
Jul 20 15:38:51.500909 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.500788    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10b7375f-1a08-4d29-9d02-5b4066c15edd-signing-key\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.501210 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.501194    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/10b7375f-1a08-4d29-9d02-5b4066c15edd-signing-cabundle\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.503052 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.503036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/10b7375f-1a08-4d29-9d02-5b4066c15edd-signing-key\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.512535 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.512515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfm6j\" (UniqueName: \"kubernetes.io/projected/10b7375f-1a08-4d29-9d02-5b4066c15edd-kube-api-access-vfm6j\") pod \"service-ca-58598695f7-cnzf2\" (UID: \"10b7375f-1a08-4d29-9d02-5b4066c15edd\") " pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.546081 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.546048    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-cnzf2"
Jul 20 15:38:51.712052 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:51.712021    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-cnzf2"]
Jul 20 15:38:51.715354 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:51.715325    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b7375f_1a08_4d29_9d02_5b4066c15edd.slice/crio-97c241708d8b9df0592f3064ee44671062952ceff12695f0e8bdc15b8f1c26fd WatchSource:0}: Error finding container 97c241708d8b9df0592f3064ee44671062952ceff12695f0e8bdc15b8f1c26fd: Status 404 returned error can't find the container with id 97c241708d8b9df0592f3064ee44671062952ceff12695f0e8bdc15b8f1c26fd
Jul 20 15:38:52.326709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:52.326681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p8zm2_6d4fff96-98b6-443e-a673-968187ab8f33/dns-node-resolver/0.log"
Jul 20 15:38:52.646145 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:52.646062    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-cnzf2" event={"ID":"10b7375f-1a08-4d29-9d02-5b4066c15edd","Type":"ContainerStarted","Data":"97c241708d8b9df0592f3064ee44671062952ceff12695f0e8bdc15b8f1c26fd"}
Jul 20 15:38:53.326634 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:53.326602    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-852hk_c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7/node-ca/0.log"
Jul 20 15:38:53.517729 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:53.517691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:53.517729 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:53.517733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:53.518209 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:53.517826    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:38:53.518209 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:53.517866    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:53.518209 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:53.517914    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:57.517894703 +0000 UTC m=+50.632744780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:53.518209 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:53.517931    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:38:57.517922291 +0000 UTC m=+50.632772354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : configmap "kube-rbac-proxy" not found
Jul 20 15:38:54.126635 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:54.126612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lksdr_0ae2a2c0-53df-4000-b770-5292e22a24e7/serve-healthcheck-canary/0.log"
Jul 20 15:38:54.652955 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:54.652923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-cnzf2" event={"ID":"10b7375f-1a08-4d29-9d02-5b4066c15edd","Type":"ContainerStarted","Data":"b5a1fd42830781e68cbd568fb8e9a6c400643e5a3729b52ec0902fecd73be655"}
Jul 20 15:38:54.679406 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:54.679353    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-cnzf2" podStartSLOduration=1.311569986 podStartE2EDuration="3.679337042s" totalImagesPullingTime="2.367767056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:54.678666521 +0000 UTC m=+47.793516608" watchObservedRunningTime="2026-07-20 15:38:54.679337042 +0000 UTC m=+47.794187126"
Jul 20 15:38:57.552507 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:57.552470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:57.552507 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:57.552509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:38:57.553054 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:57.552623    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:57.553054 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:57.552671    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:39:05.552657357 +0000 UTC m=+58.667507421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : secret "insights-runtime-extractor-tls" not found
Jul 20 15:38:57.553054 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:57.552620    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 15:38:57.553054 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:38:57.552767    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm podName:f749663d-097d-4f09-89e3-3ad02eb02f6d nodeName:}" failed. No retries permitted until 2026-07-20 15:39:05.552748382 +0000 UTC m=+58.667598446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-79wps" (UID: "f749663d-097d-4f09-89e3-3ad02eb02f6d") : configmap "kube-rbac-proxy" not found
Jul 20 15:38:59.065132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.065084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:59.065132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.065129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:59.067409 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.067378    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8872159f-72c6-44e9-9c76-50488fcbeb3e-metrics-tls\") pod \"dns-default-7vcqv\" (UID: \"8872159f-72c6-44e9-9c76-50488fcbeb3e\") " pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:59.067636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.067614    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"image-registry-5bdd9f6f4d-lljcx\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") " pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:59.186518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.186480    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:38:59.193683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.193656    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:59.354131 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.354101    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vcqv"]
Jul 20 15:38:59.357666 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:59.357639    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8872159f_72c6_44e9_9c76_50488fcbeb3e.slice/crio-0813dbfb963ab893b071f560180a476ac5b0541b5183f09c6d3eff4813a805a8 WatchSource:0}: Error finding container 0813dbfb963ab893b071f560180a476ac5b0541b5183f09c6d3eff4813a805a8: Status 404 returned error can't find the container with id 0813dbfb963ab893b071f560180a476ac5b0541b5183f09c6d3eff4813a805a8
Jul 20 15:38:59.372961 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.372589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"]
Jul 20 15:38:59.376123 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:38:59.376093    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd54b6e_7d99_4042_8192_02b3fcc18e9f.slice/crio-c3b96fb5725773185067cadd0397ff861d602025d8a8459c3ec92723e9cf970a WatchSource:0}: Error finding container c3b96fb5725773185067cadd0397ff861d602025d8a8459c3ec92723e9cf970a: Status 404 returned error can't find the container with id c3b96fb5725773185067cadd0397ff861d602025d8a8459c3ec92723e9cf970a
Jul 20 15:38:59.667894 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.667789    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx" event={"ID":"9bd54b6e-7d99-4042-8192-02b3fcc18e9f","Type":"ContainerStarted","Data":"3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae"}
Jul 20 15:38:59.667894 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.667868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx" event={"ID":"9bd54b6e-7d99-4042-8192-02b3fcc18e9f","Type":"ContainerStarted","Data":"c3b96fb5725773185067cadd0397ff861d602025d8a8459c3ec92723e9cf970a"}
Jul 20 15:38:59.668482 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.668460    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:38:59.669426 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:38:59.669403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vcqv" event={"ID":"8872159f-72c6-44e9-9c76-50488fcbeb3e","Type":"ContainerStarted","Data":"0813dbfb963ab893b071f560180a476ac5b0541b5183f09c6d3eff4813a805a8"}
Jul 20 15:39:01.678370 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:01.678299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vcqv" event={"ID":"8872159f-72c6-44e9-9c76-50488fcbeb3e","Type":"ContainerStarted","Data":"848267777e7628cac41e8819a9d75c634484b9f3b93ba40d93edf903e1982ce3"}
Jul 20 15:39:02.682489 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:02.682454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vcqv" event={"ID":"8872159f-72c6-44e9-9c76-50488fcbeb3e","Type":"ContainerStarted","Data":"5e1a5af8234f512cb7a50aed8337e949285443b03b21493bcd7d928d55f41b7b"}
Jul 20 15:39:02.682921 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:02.682587    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:39:02.707084 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:02.707025    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7vcqv" podStartSLOduration=17.58686221 podStartE2EDuration="19.707005751s" totalImagesPullingTime="2.120143541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:02.706471793 +0000 UTC m=+55.821321888" watchObservedRunningTime="2026-07-20 15:39:02.707005751 +0000 UTC m=+55.821855837"
Jul 20 15:39:02.707471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:02.707443    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx" podStartSLOduration=56.707433568 podStartE2EDuration="56.707433568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:38:59.706314994 +0000 UTC m=+52.821165080" watchObservedRunningTime="2026-07-20 15:39:02.707433568 +0000 UTC m=+55.822283652"
Jul 20 15:39:05.621174 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:05.621133    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:39:05.621174 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:05.621174    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:39:05.621792 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:05.621771    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f749663d-097d-4f09-89e3-3ad02eb02f6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:39:05.623481 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:05.623454    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f749663d-097d-4f09-89e3-3ad02eb02f6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-79wps\" (UID: \"f749663d-097d-4f09-89e3-3ad02eb02f6d\") " pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:39:05.687383 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:05.687346    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-79wps"
Jul 20 15:39:05.810772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:05.810739    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-79wps"]
Jul 20 15:39:05.813374 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:05.813347    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf749663d_097d_4f09_89e3_3ad02eb02f6d.slice/crio-de4f012cf75e81353b821f7c7a94f45b55eb666c9cc311c2db80a9098b498122 WatchSource:0}: Error finding container de4f012cf75e81353b821f7c7a94f45b55eb666c9cc311c2db80a9098b498122: Status 404 returned error can't find the container with id de4f012cf75e81353b821f7c7a94f45b55eb666c9cc311c2db80a9098b498122
Jul 20 15:39:06.694103 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:06.694065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79wps" event={"ID":"f749663d-097d-4f09-89e3-3ad02eb02f6d","Type":"ContainerStarted","Data":"de4f012cf75e81353b821f7c7a94f45b55eb666c9cc311c2db80a9098b498122"}
Jul 20 15:39:07.596173 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:07.596144    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ztv8w"
Jul 20 15:39:11.712200 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:11.712156    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79wps" event={"ID":"f749663d-097d-4f09-89e3-3ad02eb02f6d","Type":"ContainerStarted","Data":"751a86a9c01f00bacd393f6c42153078a42547e62b491300e3f64f068198cf0d"}
Jul 20 15:39:11.938213 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:11.938175    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"]
Jul 20 15:39:12.025023 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.024986    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-q6k2x"]
Jul 20 15:39:12.027362 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.027341    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:12.029940 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.029918    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 15:39:12.031301 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.031275    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-98wxr\""
Jul 20 15:39:12.031412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.031272    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 15:39:12.043977 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.043937    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q6k2x"]
Jul 20 15:39:12.067277 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.067241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hgj\" (UniqueName: \"kubernetes.io/projected/fb2f7272-19cb-40a0-9cc5-da9fa6a35af0-kube-api-access-75hgj\") pod \"downloads-5bc67dcd46-q6k2x\" (UID: \"fb2f7272-19cb-40a0-9cc5-da9fa6a35af0\") " pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:12.168404 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.168355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hgj\" (UniqueName: \"kubernetes.io/projected/fb2f7272-19cb-40a0-9cc5-da9fa6a35af0-kube-api-access-75hgj\") pod \"downloads-5bc67dcd46-q6k2x\" (UID: \"fb2f7272-19cb-40a0-9cc5-da9fa6a35af0\") " pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:12.180147 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.180110    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hgj\" (UniqueName: \"kubernetes.io/projected/fb2f7272-19cb-40a0-9cc5-da9fa6a35af0-kube-api-access-75hgj\") pod \"downloads-5bc67dcd46-q6k2x\" (UID: \"fb2f7272-19cb-40a0-9cc5-da9fa6a35af0\") " pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:12.337338 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.337265    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:12.687652 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:12.687583    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vcqv"
Jul 20 15:39:13.074348 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.074311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:39:13.074824 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.074397    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:39:13.078523 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.078492    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 15:39:13.078523 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.078507    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 15:39:13.087477 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.087450    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04b04807-15ac-4c14-996b-fc7456ca4621-original-pull-secret\") pod \"global-pull-secret-syncer-rflsh\" (UID: \"04b04807-15ac-4c14-996b-fc7456ca4621\") " pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:39:13.087625 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.087475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ee2ac86-e86d-4ff0-9a76-24773f962f61-metrics-certs\") pod \"network-metrics-daemon-bkt82\" (UID: \"3ee2ac86-e86d-4ff0-9a76-24773f962f61\") " pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:39:13.169548 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.169509    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rflsh"
Jul 20 15:39:13.174985 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.174955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:39:13.182390 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.182363    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 15:39:13.185146 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.185119    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdf5b\""
Jul 20 15:39:13.188465 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.188443    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 15:39:13.192589 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.192568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bkt82"
Jul 20 15:39:13.198847 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.198817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7hhs\" (UniqueName: \"kubernetes.io/projected/54319d6a-7d6d-4678-994b-bd4566eb35db-kube-api-access-w7hhs\") pod \"network-check-target-424gk\" (UID: \"54319d6a-7d6d-4678-994b-bd4566eb35db\") " pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:39:13.478625 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.478548    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bmp9c\""
Jul 20 15:39:13.487408 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:13.487379    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:39:14.400340 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.400304    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q6k2x"]
Jul 20 15:39:14.403411 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:14.403386    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2f7272_19cb_40a0_9cc5_da9fa6a35af0.slice/crio-57c9f6576299ea8b7d2a59ed66e7457c185ad5f172aecea22774697f25dace8c WatchSource:0}: Error finding container 57c9f6576299ea8b7d2a59ed66e7457c185ad5f172aecea22774697f25dace8c: Status 404 returned error can't find the container with id 57c9f6576299ea8b7d2a59ed66e7457c185ad5f172aecea22774697f25dace8c
Jul 20 15:39:14.409519 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.409496    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-424gk"]
Jul 20 15:39:14.413959 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:14.413931    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54319d6a_7d6d_4678_994b_bd4566eb35db.slice/crio-53379e6b1d7d2362c9f5dbd24389d1db9e5915c8ee14bdf34457d22d2783f457 WatchSource:0}: Error finding container 53379e6b1d7d2362c9f5dbd24389d1db9e5915c8ee14bdf34457d22d2783f457: Status 404 returned error can't find the container with id 53379e6b1d7d2362c9f5dbd24389d1db9e5915c8ee14bdf34457d22d2783f457
Jul 20 15:39:14.629977 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.629900    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rflsh"]
Jul 20 15:39:14.631356 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.631334    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bkt82"]
Jul 20 15:39:14.632975 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:14.632954    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b04807_15ac_4c14_996b_fc7456ca4621.slice/crio-3b7d1310a25709b9ca0e1603cdf55e2e1533dce2da86c78ea5a04bcaffe0215a WatchSource:0}: Error finding container 3b7d1310a25709b9ca0e1603cdf55e2e1533dce2da86c78ea5a04bcaffe0215a: Status 404 returned error can't find the container with id 3b7d1310a25709b9ca0e1603cdf55e2e1533dce2da86c78ea5a04bcaffe0215a
Jul 20 15:39:14.633944 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:14.633919    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee2ac86_e86d_4ff0_9a76_24773f962f61.slice/crio-8f915fce9488eadf37b3bf69c6b1c9f56990bda34487c0d6dc0877915b8d8d47 WatchSource:0}: Error finding container 8f915fce9488eadf37b3bf69c6b1c9f56990bda34487c0d6dc0877915b8d8d47: Status 404 returned error can't find the container with id 8f915fce9488eadf37b3bf69c6b1c9f56990bda34487c0d6dc0877915b8d8d47
Jul 20 15:39:14.724493 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.724451    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q6k2x" event={"ID":"fb2f7272-19cb-40a0-9cc5-da9fa6a35af0","Type":"ContainerStarted","Data":"57c9f6576299ea8b7d2a59ed66e7457c185ad5f172aecea22774697f25dace8c"}
Jul 20 15:39:14.725628 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.725591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkt82" event={"ID":"3ee2ac86-e86d-4ff0-9a76-24773f962f61","Type":"ContainerStarted","Data":"8f915fce9488eadf37b3bf69c6b1c9f56990bda34487c0d6dc0877915b8d8d47"}
Jul 20 15:39:14.726645 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.726619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rflsh" event={"ID":"04b04807-15ac-4c14-996b-fc7456ca4621","Type":"ContainerStarted","Data":"3b7d1310a25709b9ca0e1603cdf55e2e1533dce2da86c78ea5a04bcaffe0215a"}
Jul 20 15:39:14.728311 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.728293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79wps" event={"ID":"f749663d-097d-4f09-89e3-3ad02eb02f6d","Type":"ContainerStarted","Data":"7e4fbce775a80ec61d46ea1508ea5f26d509d07aa76b46020d6d634b89f387aa"}
Jul 20 15:39:14.729292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:14.729274    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-424gk" event={"ID":"54319d6a-7d6d-4678-994b-bd4566eb35db","Type":"ContainerStarted","Data":"53379e6b1d7d2362c9f5dbd24389d1db9e5915c8ee14bdf34457d22d2783f457"}
Jul 20 15:39:16.314412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.314361    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7767d59bd-7lgb7"]
Jul 20 15:39:16.326669 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.325767    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.329912    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.329974    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7767d59bd-7lgb7"]
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.330329    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-96s6k\""
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.330339    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.330570    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.330745    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 15:39:16.331203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.330946    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 15:39:16.398170 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.398133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-config\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.398323 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.398219    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-oauth-serving-cert\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.398323 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.398254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-oauth-config\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.398323 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.398295    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-service-ca\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.398323 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.398320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd92r\" (UniqueName: \"kubernetes.io/projected/a53c1506-7c95-4528-b79c-9c6fb05e8c22-kube-api-access-wd92r\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.398542 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.398383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-serving-cert\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.498887    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-oauth-serving-cert\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.498942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-oauth-config\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.498976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-service-ca\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.499007    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd92r\" (UniqueName: \"kubernetes.io/projected/a53c1506-7c95-4528-b79c-9c6fb05e8c22-kube-api-access-wd92r\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.499038    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-serving-cert\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.499079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-config\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.499875 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.499811    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-oauth-serving-cert\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.500367 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.499928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-config\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.500367 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.500185    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-service-ca\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.504910 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.504859    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-serving-cert\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.514964 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.514936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-oauth-config\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.517778 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.517751    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd92r\" (UniqueName: \"kubernetes.io/projected/a53c1506-7c95-4528-b79c-9c6fb05e8c22-kube-api-access-wd92r\") pod \"console-7767d59bd-7lgb7\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") " pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.643215 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.643173    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:16.746380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.746336    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkt82" event={"ID":"3ee2ac86-e86d-4ff0-9a76-24773f962f61","Type":"ContainerStarted","Data":"a2a6e2981d3b0e8bc3d4ffcee909d3c8e14db19de56adf3d6198239f9ee17c3d"}
Jul 20 15:39:16.746550 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.746414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bkt82" event={"ID":"3ee2ac86-e86d-4ff0-9a76-24773f962f61","Type":"ContainerStarted","Data":"fd4a6eb9d1a83bb54aae1a9e53e3892af11eee9aa57a4510a9fde36f7e62c89f"}
Jul 20 15:39:16.843296 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:16.843211    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7767d59bd-7lgb7"]
Jul 20 15:39:16.847017 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:16.846922    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53c1506_7c95_4528_b79c_9c6fb05e8c22.slice/crio-78a64ea93b1efe9dcaa1e8b19aba231d7bd0f6854b8543be7a696f47761ad6d9 WatchSource:0}: Error finding container 78a64ea93b1efe9dcaa1e8b19aba231d7bd0f6854b8543be7a696f47761ad6d9: Status 404 returned error can't find the container with id 78a64ea93b1efe9dcaa1e8b19aba231d7bd0f6854b8543be7a696f47761ad6d9
Jul 20 15:39:17.759116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:17.759044    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7767d59bd-7lgb7" event={"ID":"a53c1506-7c95-4528-b79c-9c6fb05e8c22","Type":"ContainerStarted","Data":"78a64ea93b1efe9dcaa1e8b19aba231d7bd0f6854b8543be7a696f47761ad6d9"}
Jul 20 15:39:17.780510 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:17.780438    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bkt82" podStartSLOduration=69.064772162 podStartE2EDuration="1m10.780416385s" totalImagesPullingTime="1.715644223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:17.779036514 +0000 UTC m=+70.893886600" watchObservedRunningTime="2026-07-20 15:39:17.780416385 +0000 UTC m=+70.895266472"
Jul 20 15:39:18.510063 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.509330    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf95d485d-5zxtv"]
Jul 20 15:39:18.512226 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.512195    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.520554 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.520398    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 15:39:18.526120 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.525412    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf95d485d-5zxtv"]
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.613990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-trusted-ca-bundle\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.614054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftll\" (UniqueName: \"kubernetes.io/projected/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-kube-api-access-6ftll\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.614087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-config\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.614120    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-serving-cert\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.614168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-service-ca\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.614193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-oauth-config\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.614368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.614224    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-oauth-serving-cert\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-trusted-ca-bundle\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftll\" (UniqueName: \"kubernetes.io/projected/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-kube-api-access-6ftll\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-config\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715176    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-serving-cert\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715223    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-service-ca\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-oauth-config\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.715282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-oauth-serving-cert\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.716437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.716383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-config\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.717394 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.717353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-service-ca\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.717911 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.717886    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-oauth-serving-cert\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.718253 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.718218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-trusted-ca-bundle\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.720355 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.720313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-serving-cert\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.723142 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.723093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-oauth-config\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.726639 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.726594    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftll\" (UniqueName: \"kubernetes.io/projected/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-kube-api-access-6ftll\") pod \"console-bf95d485d-5zxtv\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") " pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:18.827065 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:18.826985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:21.355810 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.355773    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"]
Jul 20 15:39:21.372039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.372005    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.374571    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zzjgw\""
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.374894    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.375215    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.375318    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"]
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.375381    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.375496    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 15:39:21.375854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.375550    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 15:39:21.391066 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.391033    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nhvh8"]
Jul 20 15:39:21.393531 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.393511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.396290 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.395873    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 15:39:21.396290 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.395884    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 15:39:21.396290 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.396129    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 15:39:21.396553 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.396526    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7rdt4\""
Jul 20 15:39:21.436665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-sys\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.436665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436567    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc420100-b9ba-4bac-b742-389a214ed786-metrics-client-ca\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.436665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzvf5\" (UniqueName: \"kubernetes.io/projected/27f7d23e-29da-433b-9372-59ebec564723-kube-api-access-kzvf5\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.436665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27f7d23e-29da-433b-9372-59ebec564723-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.436665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhx4t\" (UniqueName: \"kubernetes.io/projected/fc420100-b9ba-4bac-b742-389a214ed786-kube-api-access-jhx4t\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-textfile\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436758    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f7d23e-29da-433b-9372-59ebec564723-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-wtmp\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-root\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436864    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-tls\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-accelerators-collector-config\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.437078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.436977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27f7d23e-29da-433b-9372-59ebec564723-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.537699 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27f7d23e-29da-433b-9372-59ebec564723-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.537900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-sys\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.537900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc420100-b9ba-4bac-b742-389a214ed786-metrics-client-ca\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.537900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537793    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzvf5\" (UniqueName: \"kubernetes.io/projected/27f7d23e-29da-433b-9372-59ebec564723-kube-api-access-kzvf5\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.537900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27f7d23e-29da-433b-9372-59ebec564723-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.537900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhx4t\" (UniqueName: \"kubernetes.io/projected/fc420100-b9ba-4bac-b742-389a214ed786-kube-api-access-jhx4t\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.537900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-textfile\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538227 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537925    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538227 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.537952    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f7d23e-29da-433b-9372-59ebec564723-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.538604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538540    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc420100-b9ba-4bac-b742-389a214ed786-metrics-client-ca\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-wtmp\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538632    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-root\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-tls\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-accelerators-collector-config\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27f7d23e-29da-433b-9372-59ebec564723-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.538992 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538754    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-sys\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538992 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.538792    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-root\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.538992 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:39:21.538881    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 15:39:21.538992 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:39:21.538948    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-tls podName:fc420100-b9ba-4bac-b742-389a214ed786 nodeName:}" failed. No retries permitted until 2026-07-20 15:39:22.038929155 +0000 UTC m=+75.153779224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-tls") pod "node-exporter-nhvh8" (UID: "fc420100-b9ba-4bac-b742-389a214ed786") : secret "node-exporter-tls" not found
Jul 20 15:39:21.539200 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.539180    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-textfile\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.539251 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.539235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-wtmp\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.539376 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.539314    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-accelerators-collector-config\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.542210 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.542161    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/27f7d23e-29da-433b-9372-59ebec564723-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.542662 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.542639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.544724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.544699    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27f7d23e-29da-433b-9372-59ebec564723-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.548856 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.548775    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzvf5\" (UniqueName: \"kubernetes.io/projected/27f7d23e-29da-433b-9372-59ebec564723-kube-api-access-kzvf5\") pod \"openshift-state-metrics-79f6958cdf-d85rf\" (UID: \"27f7d23e-29da-433b-9372-59ebec564723\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.549816 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.549774    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhx4t\" (UniqueName: \"kubernetes.io/projected/fc420100-b9ba-4bac-b742-389a214ed786-kube-api-access-jhx4t\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:21.685432 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.685339    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"
Jul 20 15:39:21.944938 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:21.944828    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:39:22.042442 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.042404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-tls\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:22.045368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.045334    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc420100-b9ba-4bac-b742-389a214ed786-node-exporter-tls\") pod \"node-exporter-nhvh8\" (UID: \"fc420100-b9ba-4bac-b742-389a214ed786\") " pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:22.306969 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.306932    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nhvh8"
Jul 20 15:39:22.558653 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.558584    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:39:22.561497 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.561462    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.563860    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.563885    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.563899    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564179    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564187    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564274    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564333    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564474    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564517    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-np45t\""
Jul 20 15:39:22.564897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.564556    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 15:39:22.580630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.580595    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:39:22.647586 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647586 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647593    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647637    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-config-out\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-config-volume\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.647826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647822    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.648137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.648137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ppzv\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-kube-api-access-9ppzv\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.648137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.647989    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.648137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.648017    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.648137 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.648090    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-web-config\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.749355 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749318    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-web-config\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.749546 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.749546 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.749546 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749445    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.749546 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-config-out\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.749952 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749896    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750095 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.749981    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-config-volume\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750095 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750095 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750095 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750117    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ppzv\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-kube-api-access-9ppzv\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.750319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.750208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.752036 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.751343    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.752036 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.751976    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.752588 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.752558    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-config-out\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.753334 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.753290    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-web-config\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.753767 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.753743    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.754884 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.754528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.754884 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.754847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.755486 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.755444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.755592 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.755494    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-config-volume\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.756130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.756091    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.757365 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.757322    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.761451 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.761412    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ppzv\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-kube-api-access-9ppzv\") pod \"alertmanager-main-0\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:22.874197 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:22.874113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:39:24.037867 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.037778    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf95d485d-5zxtv"]
Jul 20 15:39:24.048127 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:24.048058    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5ad931_f98c_4c3b_9d10_f11c1aa14c0d.slice/crio-0e532a7f88d75d2b96c1e06c500fa147f2278fa57c39021a56287a840bc6d136 WatchSource:0}: Error finding container 0e532a7f88d75d2b96c1e06c500fa147f2278fa57c39021a56287a840bc6d136: Status 404 returned error can't find the container with id 0e532a7f88d75d2b96c1e06c500fa147f2278fa57c39021a56287a840bc6d136
Jul 20 15:39:24.087948 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.087735    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf"]
Jul 20 15:39:24.089783 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.089725    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:39:24.092299 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:24.092257    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922b5507_1209_43eb_9e12_219b184d662b.slice/crio-aa113e21e84b7dba4b2895327257d5c852a81a4d11e4adf387f4f253d6b76f81 WatchSource:0}: Error finding container aa113e21e84b7dba4b2895327257d5c852a81a4d11e4adf387f4f253d6b76f81: Status 404 returned error can't find the container with id aa113e21e84b7dba4b2895327257d5c852a81a4d11e4adf387f4f253d6b76f81
Jul 20 15:39:24.093336 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:24.093307    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f7d23e_29da_433b_9372_59ebec564723.slice/crio-b40e4b2403740472f68bf613c71266d0d5ad90682c1cd126aef8c5605f8a4660 WatchSource:0}: Error finding container b40e4b2403740472f68bf613c71266d0d5ad90682c1cd126aef8c5605f8a4660: Status 404 returned error can't find the container with id b40e4b2403740472f68bf613c71266d0d5ad90682c1cd126aef8c5605f8a4660
Jul 20 15:39:24.792869 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.792823    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rflsh" event={"ID":"04b04807-15ac-4c14-996b-fc7456ca4621","Type":"ContainerStarted","Data":"8182152c284ce6281d01b3f6bb670c4ad25317fe1ddcc8876d2f4f33cf5c7913"}
Jul 20 15:39:24.794981 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.794898    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7767d59bd-7lgb7" event={"ID":"a53c1506-7c95-4528-b79c-9c6fb05e8c22","Type":"ContainerStarted","Data":"54af4536676d75af1d4fda34cda931a06c0c8b9266c40e2052727f61df8d2205"}
Jul 20 15:39:24.796473 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.796403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"aa113e21e84b7dba4b2895327257d5c852a81a4d11e4adf387f4f253d6b76f81"}
Jul 20 15:39:24.799321 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.799210    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf" event={"ID":"27f7d23e-29da-433b-9372-59ebec564723","Type":"ContainerStarted","Data":"972b0acc5d9fc54f083ca4a7b4096d6248eb8ff4db18a4cc33dc45e5e0639daa"}
Jul 20 15:39:24.799321 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.799260    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf" event={"ID":"27f7d23e-29da-433b-9372-59ebec564723","Type":"ContainerStarted","Data":"6b5cfb17be86fa158aee75f3d4650efef47772aeed7b02238c0e08e5a8b5fec3"}
Jul 20 15:39:24.799321 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.799289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf" event={"ID":"27f7d23e-29da-433b-9372-59ebec564723","Type":"ContainerStarted","Data":"b40e4b2403740472f68bf613c71266d0d5ad90682c1cd126aef8c5605f8a4660"}
Jul 20 15:39:24.801323 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.801298    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf95d485d-5zxtv" event={"ID":"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d","Type":"ContainerStarted","Data":"1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b"}
Jul 20 15:39:24.801420 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.801337    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf95d485d-5zxtv" event={"ID":"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d","Type":"ContainerStarted","Data":"0e532a7f88d75d2b96c1e06c500fa147f2278fa57c39021a56287a840bc6d136"}
Jul 20 15:39:24.804149 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.804115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-79wps" event={"ID":"f749663d-097d-4f09-89e3-3ad02eb02f6d","Type":"ContainerStarted","Data":"f46a21e6b6f959a2a557241bb34dbf7c2b77358bbdc74bf19c6457f879d68a2e"}
Jul 20 15:39:24.806181 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.805996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-424gk" event={"ID":"54319d6a-7d6d-4678-994b-bd4566eb35db","Type":"ContainerStarted","Data":"8645be9f24249cd5747e88553f72c7ee74cddafb12ac9d5635de38efebec0220"}
Jul 20 15:39:24.806181 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.806055    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:39:24.807435 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.807414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhvh8" event={"ID":"fc420100-b9ba-4bac-b742-389a214ed786","Type":"ContainerStarted","Data":"9d6bce9bb1c27867d5dcda0011365efbe4d360d6c82008c529c9bd0ca9aa645f"}
Jul 20 15:39:24.838976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.838816    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rflsh" podStartSLOduration=68.66897219 podStartE2EDuration="1m17.838793292s" totalImagesPullingTime="9.169821102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:24.83848308 +0000 UTC m=+77.953333165" watchObservedRunningTime="2026-07-20 15:39:24.838793292 +0000 UTC m=+77.953643371"
Jul 20 15:39:24.859704 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.859623    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7767d59bd-7lgb7" podStartSLOduration=1.8752916370000001 podStartE2EDuration="8.859599143s" totalImagesPullingTime="6.984307506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:24.857537054 +0000 UTC m=+77.972387140" watchObservedRunningTime="2026-07-20 15:39:24.859599143 +0000 UTC m=+77.974449230"
Jul 20 15:39:24.879259 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.879007    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-79wps" podStartSLOduration=18.03590648 podStartE2EDuration="35.878986223s" totalImagesPullingTime="17.843079743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 15:38:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:24.878736113 +0000 UTC m=+77.993586199" watchObservedRunningTime="2026-07-20 15:39:24.878986223 +0000 UTC m=+77.993836305"
Jul 20 15:39:24.920671 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.920598    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-424gk" podStartSLOduration=68.531075709 podStartE2EDuration="1m17.920583748s" totalImagesPullingTime="9.389508039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:24.91977451 +0000 UTC m=+78.034624596" watchObservedRunningTime="2026-07-20 15:39:24.920583748 +0000 UTC m=+78.035433835"
Jul 20 15:39:24.922038 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:24.921993    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf95d485d-5zxtv" podStartSLOduration=6.921981745 podStartE2EDuration="6.921981745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:24.901718815 +0000 UTC m=+78.016568903" watchObservedRunningTime="2026-07-20 15:39:24.921981745 +0000 UTC m=+78.036831847"
Jul 20 15:39:25.802733 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.802706    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7f458df58f-59jvp"]
Jul 20 15:39:25.807191 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.807170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.809266 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.809077    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 15:39:25.809364 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.809346    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 15:39:25.809652 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.809590    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fr5tc\""
Jul 20 15:39:25.809790 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.809767    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 15:39:25.809927 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.809826    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 15:39:25.810160 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.810135    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3caukgss877ri\""
Jul 20 15:39:25.813284 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.813256    2569 generic.go:356] "Generic (PLEG): container finished" podID="fc420100-b9ba-4bac-b742-389a214ed786" containerID="c6610dd160a45317a5e6d47ea5a6a210d8996005bba9d4729faaf9261f789568" exitCode=0
Jul 20 15:39:25.813385 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.813348    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhvh8" event={"ID":"fc420100-b9ba-4bac-b742-389a214ed786","Type":"ContainerDied","Data":"c6610dd160a45317a5e6d47ea5a6a210d8996005bba9d4729faaf9261f789568"}
Jul 20 15:39:25.815927 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.815888    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f458df58f-59jvp"]
Jul 20 15:39:25.887536 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887505    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-client-ca-bundle\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.887629 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhkhb\" (UniqueName: \"kubernetes.io/projected/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-kube-api-access-rhkhb\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.887629 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887596    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-metrics-server-audit-profiles\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.887785 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.887785 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-secret-metrics-server-tls\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.888044 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-secret-metrics-server-client-certs\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.888044 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.887923    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-audit-log\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988475 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988440    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-client-ca-bundle\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988617 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988481    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhkhb\" (UniqueName: \"kubernetes.io/projected/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-kube-api-access-rhkhb\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988617 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-metrics-server-audit-profiles\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988617 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988617 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-secret-metrics-server-tls\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988617 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-secret-metrics-server-client-certs\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.988862 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.988644    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-audit-log\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.989035 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.989003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-audit-log\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.989586 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.989564    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-metrics-server-audit-profiles\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.989715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.989692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.991371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.991328    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-secret-metrics-server-tls\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.991493 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.991453    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-client-ca-bundle\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.992125 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.992101    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-secret-metrics-server-client-certs\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:25.997552 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:25.997520    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhkhb\" (UniqueName: \"kubernetes.io/projected/8324d88d-565b-4f2b-a228-ae1a5f9e5b03-kube-api-access-rhkhb\") pod \"metrics-server-7f458df58f-59jvp\" (UID: \"8324d88d-565b-4f2b-a228-ae1a5f9e5b03\") " pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:26.140291 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.140163    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:26.140608 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.140587    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7767d59bd-7lgb7"]
Jul 20 15:39:26.180264 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.180230    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58d7ddb55d-rc5n7"]
Jul 20 15:39:26.185200 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.185160    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.198361 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.198333    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d7ddb55d-rc5n7"]
Jul 20 15:39:26.291523 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-service-ca\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.291710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-oauth-config\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.291710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658z9\" (UniqueName: \"kubernetes.io/projected/92e1b755-5690-4108-9f2a-85c8a11f3605-kube-api-access-658z9\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.291710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291682    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-trusted-ca-bundle\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.291888 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-oauth-serving-cert\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.291888 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-console-config\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.291888 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.291801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-serving-cert\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.306353 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.306278    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7f458df58f-59jvp"]
Jul 20 15:39:26.393142 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-serving-cert\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.393142 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393101    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-service-ca\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.393368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-oauth-config\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.393368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-658z9\" (UniqueName: \"kubernetes.io/projected/92e1b755-5690-4108-9f2a-85c8a11f3605-kube-api-access-658z9\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.393368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-trusted-ca-bundle\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.393645 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-oauth-serving-cert\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.393792 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.393671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-console-config\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.394144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.394113    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-service-ca\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.394321 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.394270    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-oauth-serving-cert\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.394321 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.394292    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-trusted-ca-bundle\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.394470 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.394385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-console-config\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.396048 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.396026    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-serving-cert\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.396298 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.396283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-oauth-config\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.403061 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.403039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-658z9\" (UniqueName: \"kubernetes.io/projected/92e1b755-5690-4108-9f2a-85c8a11f3605-kube-api-access-658z9\") pod \"console-58d7ddb55d-rc5n7\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") " pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.498348 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.498309    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:26.603439 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.603411    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c5744fb89-kscr6"]
Jul 20 15:39:26.606994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.606966    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.609412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.609390    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 15:39:26.609550 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.609519    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 15:39:26.609937 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.609866    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 15:39:26.610127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.610089    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tgs8w\""
Jul 20 15:39:26.610309 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.610283    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 15:39:26.610497 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.610482    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 15:39:26.617457 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.617434    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 15:39:26.623308 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.623287    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c5744fb89-kscr6"]
Jul 20 15:39:26.643762 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.643690    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:26.643762 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.643744    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:26.650323 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.650284    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:26.695631 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-federate-client-tls\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.695815 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695653    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-secret-telemeter-client\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.695815 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-metrics-client-ca\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.695815 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695732    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-telemeter-client-tls\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.695815 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mptz\" (UniqueName: \"kubernetes.io/projected/29bb47b8-1117-4109-888e-391efea5a902-kube-api-access-4mptz\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.696018 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.696018 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-serving-certs-ca-bundle\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.696018 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.695981    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.796795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.796758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-secret-telemeter-client\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.796795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.796802    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-metrics-client-ca\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797067 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.796957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-telemeter-client-tls\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797067 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mptz\" (UniqueName: \"kubernetes.io/projected/29bb47b8-1117-4109-888e-391efea5a902-kube-api-access-4mptz\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797172 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797100    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797172 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797136    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-serving-certs-ca-bundle\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797172 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797162    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797316 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-federate-client-tls\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797599 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797547    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-metrics-client-ca\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.797907 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.797849    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-serving-certs-ca-bundle\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.798355 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.798330    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29bb47b8-1117-4109-888e-391efea5a902-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.799698 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.799666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-secret-telemeter-client\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.800089 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.800068    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-federate-client-tls\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.800184 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.800068    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-telemeter-client-tls\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.800478 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.800454    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/29bb47b8-1117-4109-888e-391efea5a902-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.816687 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.816656    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mptz\" (UniqueName: \"kubernetes.io/projected/29bb47b8-1117-4109-888e-391efea5a902-kube-api-access-4mptz\") pod \"telemeter-client-5c5744fb89-kscr6\" (UID: \"29bb47b8-1117-4109-888e-391efea5a902\") " pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.820345 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.820311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhvh8" event={"ID":"fc420100-b9ba-4bac-b742-389a214ed786","Type":"ContainerStarted","Data":"f33fdca0793335a452e49b6b4c0aa07519818a2a2393d5ffa4d79fe1f12e5ac1"}
Jul 20 15:39:26.820454 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.820410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nhvh8" event={"ID":"fc420100-b9ba-4bac-b742-389a214ed786","Type":"ContainerStarted","Data":"786ccb779b69580372ae82283db97c2143b374a36da369220ea7b62ccdde89bf"}
Jul 20 15:39:26.822502 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.822079    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e" exitCode=0
Jul 20 15:39:26.822502 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.822106    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e"}
Jul 20 15:39:26.825505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.825436    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf" event={"ID":"27f7d23e-29da-433b-9372-59ebec564723","Type":"ContainerStarted","Data":"fa2f282d25285d05ab232f2fd29c26c0f621d68bdeca61b2170baf04fa755065"}
Jul 20 15:39:26.830124 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.830104    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:26.851105 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.851053    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nhvh8" podStartSLOduration=4.800212346 podStartE2EDuration="5.851033133s" totalImagesPullingTime="954.578406ms" totalInitContainerRuntime="96.242381ms" isStatefulPod=true podCreationTimestamp="2026-07-20 15:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:26.850952557 +0000 UTC m=+79.965802641" watchObservedRunningTime="2026-07-20 15:39:26.851033133 +0000 UTC m=+79.965883219"
Jul 20 15:39:26.918695 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.918587    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6"
Jul 20 15:39:26.961753 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:26.961690    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-d85rf" podStartSLOduration=4.426511656 podStartE2EDuration="5.961657576s" totalImagesPullingTime="1.53514592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:26.960708168 +0000 UTC m=+80.075558254" watchObservedRunningTime="2026-07-20 15:39:26.961657576 +0000 UTC m=+80.076507643"
Jul 20 15:39:28.828070 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:28.827779    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:28.828070 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:28.827865    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:28.833522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:28.833496    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:28.837679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:28.837651    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:39:33.558705 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:33.558673    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8324d88d_565b_4f2b_a228_ae1a5f9e5b03.slice/crio-4f8cd075d49ede452a7bed214216afb2130c87d3912e4d66d4f83731aad92f38 WatchSource:0}: Error finding container 4f8cd075d49ede452a7bed214216afb2130c87d3912e4d66d4f83731aad92f38: Status 404 returned error can't find the container with id 4f8cd075d49ede452a7bed214216afb2130c87d3912e4d66d4f83731aad92f38
Jul 20 15:39:33.717329 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:33.717299    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d7ddb55d-rc5n7"]
Jul 20 15:39:33.720282 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:33.720257    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92e1b755_5690_4108_9f2a_85c8a11f3605.slice/crio-30751e8042b7f71afc4a7d35966c4e1f6905deac2ae076cada33ed74134292f4 WatchSource:0}: Error finding container 30751e8042b7f71afc4a7d35966c4e1f6905deac2ae076cada33ed74134292f4: Status 404 returned error can't find the container with id 30751e8042b7f71afc4a7d35966c4e1f6905deac2ae076cada33ed74134292f4
Jul 20 15:39:33.727895 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:33.727874    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c5744fb89-kscr6"]
Jul 20 15:39:33.729588 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:33.729566    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bb47b8_1117_4109_888e_391efea5a902.slice/crio-f144067700f378bf335bd6b0d7e57b49057ec86d3d788cb185b5031780145bae WatchSource:0}: Error finding container f144067700f378bf335bd6b0d7e57b49057ec86d3d788cb185b5031780145bae: Status 404 returned error can't find the container with id f144067700f378bf335bd6b0d7e57b49057ec86d3d788cb185b5031780145bae
Jul 20 15:39:33.853751 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:33.853717    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d7ddb55d-rc5n7" event={"ID":"92e1b755-5690-4108-9f2a-85c8a11f3605","Type":"ContainerStarted","Data":"30751e8042b7f71afc4a7d35966c4e1f6905deac2ae076cada33ed74134292f4"}
Jul 20 15:39:33.854896 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:33.854867    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6" event={"ID":"29bb47b8-1117-4109-888e-391efea5a902","Type":"ContainerStarted","Data":"f144067700f378bf335bd6b0d7e57b49057ec86d3d788cb185b5031780145bae"}
Jul 20 15:39:33.856212 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:33.856176    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp" event={"ID":"8324d88d-565b-4f2b-a228-ae1a5f9e5b03","Type":"ContainerStarted","Data":"4f8cd075d49ede452a7bed214216afb2130c87d3912e4d66d4f83731aad92f38"}
Jul 20 15:39:34.867301 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:34.867043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d7ddb55d-rc5n7" event={"ID":"92e1b755-5690-4108-9f2a-85c8a11f3605","Type":"ContainerStarted","Data":"d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3"}
Jul 20 15:39:34.885708 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:34.882714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q6k2x" event={"ID":"fb2f7272-19cb-40a0-9cc5-da9fa6a35af0","Type":"ContainerStarted","Data":"7379fa66d186c4b475a508adbf9d6294d640d80ca8195c907175b6b8ca906bae"}
Jul 20 15:39:34.885708 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:34.885004    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:34.894335 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:34.894310    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-q6k2x"
Jul 20 15:39:34.895727 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:34.895672    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58d7ddb55d-rc5n7" podStartSLOduration=8.895653366 podStartE2EDuration="8.895653366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:34.893406895 +0000 UTC m=+88.008257007" watchObservedRunningTime="2026-07-20 15:39:34.895653366 +0000 UTC m=+88.010503454"
Jul 20 15:39:34.916874 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:34.916798    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-q6k2x" podStartSLOduration=4.426142596 podStartE2EDuration="23.916775009s" totalImagesPullingTime="19.490632413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:34.91658835 +0000 UTC m=+88.031438436" watchObservedRunningTime="2026-07-20 15:39:34.916775009 +0000 UTC m=+88.031625095"
Jul 20 15:39:36.498945 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:36.498902    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:36.499582 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:36.498973    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:36.505444 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:36.505411    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:36.896807 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:36.896778    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:39:36.954982 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:36.954947    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf95d485d-5zxtv"]
Jul 20 15:39:36.962573 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:36.962330    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx" podUID="9bd54b6e-7d99-4042-8192-02b3fcc18e9f" containerName="registry" containerID="cri-o://3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae" gracePeriod=30
Jul 20 15:39:37.359607 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.359383    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:39:37.500310 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.500281    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-image-registry-private-configuration\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.500702 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.500346    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htpbx\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-kube-api-access-htpbx\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.500702 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.500431    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-certificates\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.500702 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.500463    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-installation-pull-secrets\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.501709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.501004    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-ca-trust-extracted\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.501709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.501041    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:37.501709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.501065    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.501709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.501097    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-trusted-ca\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.501709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.501142    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-bound-sa-token\") pod \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\" (UID: \"9bd54b6e-7d99-4042-8192-02b3fcc18e9f\") "
Jul 20 15:39:37.501709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.501411    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-certificates\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.502580 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.502529    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:37.502970 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.502942    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:39:37.503144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.503113    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-kube-api-access-htpbx" (OuterVolumeSpecName: "kube-api-access-htpbx") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "kube-api-access-htpbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:37.503406 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.503373    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:39:37.504677 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.504645    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:37.505545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.505516    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:37.512658 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.512632    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9bd54b6e-7d99-4042-8192-02b3fcc18e9f" (UID: "9bd54b6e-7d99-4042-8192-02b3fcc18e9f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:39:37.602461 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602433    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-trusted-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.602571 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602466    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-bound-sa-token\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.602571 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602481    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-image-registry-private-configuration\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.602571 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602498    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htpbx\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-kube-api-access-htpbx\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.602571 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602512    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-installation-pull-secrets\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.602571 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602525    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-ca-trust-extracted\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.602571 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.602538    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd54b6e-7d99-4042-8192-02b3fcc18e9f-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:37.898658 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.898622    2569 generic.go:356] "Generic (PLEG): container finished" podID="9bd54b6e-7d99-4042-8192-02b3fcc18e9f" containerID="3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae" exitCode=0
Jul 20 15:39:37.898851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.898701    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"
Jul 20 15:39:37.898851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.898717    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx" event={"ID":"9bd54b6e-7d99-4042-8192-02b3fcc18e9f","Type":"ContainerDied","Data":"3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae"}
Jul 20 15:39:37.898851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.898776    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdd9f6f4d-lljcx" event={"ID":"9bd54b6e-7d99-4042-8192-02b3fcc18e9f","Type":"ContainerDied","Data":"c3b96fb5725773185067cadd0397ff861d602025d8a8459c3ec92723e9cf970a"}
Jul 20 15:39:37.898851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.898795    2569 scope.go:117] "RemoveContainer" containerID="3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae"
Jul 20 15:39:37.903105 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.903078    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682"}
Jul 20 15:39:37.903209 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.903155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7"}
Jul 20 15:39:37.903209 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.903199    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4"}
Jul 20 15:39:37.903318 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.903244    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622"}
Jul 20 15:39:37.907337 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.907312    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6" event={"ID":"29bb47b8-1117-4109-888e-391efea5a902","Type":"ContainerStarted","Data":"6ddd0983d59e919af177d83569b5be8a7bb5fe263ab9d8b83b5233a90b416c40"}
Jul 20 15:39:37.907442 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.907367    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6" event={"ID":"29bb47b8-1117-4109-888e-391efea5a902","Type":"ContainerStarted","Data":"b18fe2dd89cce53f47d63a8d84dc2d2ee60633b5b368c04756dd22547da58ec8"}
Jul 20 15:39:37.907442 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.907395    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6" event={"ID":"29bb47b8-1117-4109-888e-391efea5a902","Type":"ContainerStarted","Data":"58a8d6ed096985594f8013528dcc7049507df9241efc4dbf8041f0632152f8e1"}
Jul 20 15:39:37.913385 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.912687    2569 scope.go:117] "RemoveContainer" containerID="3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae"
Jul 20 15:39:37.913385 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:39:37.913031    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae\": container with ID starting with 3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae not found: ID does not exist" containerID="3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae"
Jul 20 15:39:37.913385 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.913061    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae"} err="failed to get container status \"3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae\": rpc error: code = NotFound desc = could not find container \"3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae\": container with ID starting with 3b4b2dffe8ebf466a9d1f39194b9fc025b682460f77cc02e35caaa1e100075ae not found: ID does not exist"
Jul 20 15:39:37.915871 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.915757    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp" event={"ID":"8324d88d-565b-4f2b-a228-ae1a5f9e5b03","Type":"ContainerStarted","Data":"e216b27da0d0645ad01d7ced8952fb51de6ceda69eb816f743d381d8603af188"}
Jul 20 15:39:37.942946 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.942847    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c5744fb89-kscr6" podStartSLOduration=8.470675551 podStartE2EDuration="11.942815454s" totalImagesPullingTime="3.472139903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:37.941909541 +0000 UTC m=+91.056759631" watchObservedRunningTime="2026-07-20 15:39:37.942815454 +0000 UTC m=+91.057665539"
Jul 20 15:39:37.968520 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.968494    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"]
Jul 20 15:39:37.974132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:37.974093    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bdd9f6f4d-lljcx"]
Jul 20 15:39:38.010578 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:38.010530    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp" podStartSLOduration=9.379349194 podStartE2EDuration="13.010512494s" totalImagesPullingTime="3.6311633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:38.008787056 +0000 UTC m=+91.123637170" watchObservedRunningTime="2026-07-20 15:39:38.010512494 +0000 UTC m=+91.125362578"
Jul 20 15:39:38.923149 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:38.923109    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb"}
Jul 20 15:39:39.070857 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.070806    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c497dc7b7-bxx7g"]
Jul 20 15:39:39.071237 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.071212    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd54b6e-7d99-4042-8192-02b3fcc18e9f" containerName="registry"
Jul 20 15:39:39.071237 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.071237    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd54b6e-7d99-4042-8192-02b3fcc18e9f" containerName="registry"
Jul 20 15:39:39.071406 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.071325    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd54b6e-7d99-4042-8192-02b3fcc18e9f" containerName="registry"
Jul 20 15:39:39.086031 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.086000    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.096586 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.096553    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c497dc7b7-bxx7g"]
Jul 20 15:39:39.218190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-config\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.218297 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218205    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-oauth-config\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.218297 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-serving-cert\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.218396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218322    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f64xl\" (UniqueName: \"kubernetes.io/projected/b85ca613-c443-4e8c-9c1a-7c08059d7962-kube-api-access-f64xl\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.218396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218383    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-service-ca\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.218463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218415    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-trusted-ca-bundle\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.218463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.218439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-oauth-serving-cert\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319271 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-config\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319409 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319283    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-oauth-config\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319409 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-serving-cert\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319409 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f64xl\" (UniqueName: \"kubernetes.io/projected/b85ca613-c443-4e8c-9c1a-7c08059d7962-kube-api-access-f64xl\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319409 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319406    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-service-ca\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319631 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319435    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-trusted-ca-bundle\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.319631 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.319464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-oauth-serving-cert\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.320217 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.320070    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-config\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.320217 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.320178    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-oauth-serving-cert\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.320666 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.320640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-service-ca\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.320969 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.320945    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-trusted-ca-bundle\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.322606 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.322582    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-oauth-config\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.323215 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.323192    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-serving-cert\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.333268 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.333239    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f64xl\" (UniqueName: \"kubernetes.io/projected/b85ca613-c443-4e8c-9c1a-7c08059d7962-kube-api-access-f64xl\") pod \"console-c497dc7b7-bxx7g\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") " pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.397443 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.397394    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:39.444989 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.444946    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bd54b6e-7d99-4042-8192-02b3fcc18e9f" path="/var/lib/kubelet/pods/9bd54b6e-7d99-4042-8192-02b3fcc18e9f/volumes"
Jul 20 15:39:39.571611 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.571577    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c497dc7b7-bxx7g"]
Jul 20 15:39:39.574222 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:39:39.574195    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85ca613_c443_4e8c_9c1a_7c08059d7962.slice/crio-4a6b8a56c887bd7858f40c8e31b9da75de65e0667f3ae3ce87b3153951e8dc14 WatchSource:0}: Error finding container 4a6b8a56c887bd7858f40c8e31b9da75de65e0667f3ae3ce87b3153951e8dc14: Status 404 returned error can't find the container with id 4a6b8a56c887bd7858f40c8e31b9da75de65e0667f3ae3ce87b3153951e8dc14
Jul 20 15:39:39.933056 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.933019    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerStarted","Data":"53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af"}
Jul 20 15:39:39.934974 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.934940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c497dc7b7-bxx7g" event={"ID":"b85ca613-c443-4e8c-9c1a-7c08059d7962","Type":"ContainerStarted","Data":"6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd"}
Jul 20 15:39:39.935118 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.934995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c497dc7b7-bxx7g" event={"ID":"b85ca613-c443-4e8c-9c1a-7c08059d7962","Type":"ContainerStarted","Data":"4a6b8a56c887bd7858f40c8e31b9da75de65e0667f3ae3ce87b3153951e8dc14"}
Jul 20 15:39:39.965626 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.965567    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.630745846 podStartE2EDuration="17.965548569s" totalImagesPullingTime="13.314616642s" totalInitContainerRuntime="20.186081ms" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:39.96279701 +0000 UTC m=+93.077647094" watchObservedRunningTime="2026-07-20 15:39:39.965548569 +0000 UTC m=+93.080398653"
Jul 20 15:39:39.984901 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:39.984807    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c497dc7b7-bxx7g" podStartSLOduration=0.984786126 podStartE2EDuration="984.786126ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:39:39.984526336 +0000 UTC m=+93.099376423" watchObservedRunningTime="2026-07-20 15:39:39.984786126 +0000 UTC m=+93.099636215"
Jul 20 15:39:46.141166 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:46.141130    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:46.141626 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:46.141193    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:39:49.398191 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:49.398144    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:49.398625 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:49.398228    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:49.402809 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:49.402789    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:49.979472 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:49.979445    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:39:50.037340 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:50.037312    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58d7ddb55d-rc5n7"]
Jul 20 15:39:51.847910 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:51.847825    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7767d59bd-7lgb7" podUID="a53c1506-7c95-4528-b79c-9c6fb05e8c22" containerName="console" containerID="cri-o://54af4536676d75af1d4fda34cda931a06c0c8b9266c40e2052727f61df8d2205" gracePeriod=15
Jul 20 15:39:51.987142 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:51.987114    2569 generic.go:356] "Generic (PLEG): container finished" podID="a53c1506-7c95-4528-b79c-9c6fb05e8c22" containerID="54af4536676d75af1d4fda34cda931a06c0c8b9266c40e2052727f61df8d2205" exitCode=0
Jul 20 15:39:51.987278 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:51.987191    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7767d59bd-7lgb7" event={"ID":"a53c1506-7c95-4528-b79c-9c6fb05e8c22","Type":"ContainerDied","Data":"54af4536676d75af1d4fda34cda931a06c0c8b9266c40e2052727f61df8d2205"}
Jul 20 15:39:52.120343 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.120260    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:52.237112 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237072    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-oauth-serving-cert\") pod \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") "
Jul 20 15:39:52.237112 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237120    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-serving-cert\") pod \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") "
Jul 20 15:39:52.237412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237152    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd92r\" (UniqueName: \"kubernetes.io/projected/a53c1506-7c95-4528-b79c-9c6fb05e8c22-kube-api-access-wd92r\") pod \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") "
Jul 20 15:39:52.237412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237266    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-service-ca\") pod \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") "
Jul 20 15:39:52.237412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237310    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-config\") pod \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") "
Jul 20 15:39:52.237412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237334    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-oauth-config\") pod \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\" (UID: \"a53c1506-7c95-4528-b79c-9c6fb05e8c22\") "
Jul 20 15:39:52.237645 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237618    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-service-ca" (OuterVolumeSpecName: "service-ca") pod "a53c1506-7c95-4528-b79c-9c6fb05e8c22" (UID: "a53c1506-7c95-4528-b79c-9c6fb05e8c22"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:52.237691 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237626    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a53c1506-7c95-4528-b79c-9c6fb05e8c22" (UID: "a53c1506-7c95-4528-b79c-9c6fb05e8c22"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:52.237691 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.237659    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-config" (OuterVolumeSpecName: "console-config") pod "a53c1506-7c95-4528-b79c-9c6fb05e8c22" (UID: "a53c1506-7c95-4528-b79c-9c6fb05e8c22"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:39:52.239560 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.239535    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53c1506-7c95-4528-b79c-9c6fb05e8c22-kube-api-access-wd92r" (OuterVolumeSpecName: "kube-api-access-wd92r") pod "a53c1506-7c95-4528-b79c-9c6fb05e8c22" (UID: "a53c1506-7c95-4528-b79c-9c6fb05e8c22"). InnerVolumeSpecName "kube-api-access-wd92r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:39:52.239659 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.239538    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a53c1506-7c95-4528-b79c-9c6fb05e8c22" (UID: "a53c1506-7c95-4528-b79c-9c6fb05e8c22"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:39:52.239659 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.239609    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a53c1506-7c95-4528-b79c-9c6fb05e8c22" (UID: "a53c1506-7c95-4528-b79c-9c6fb05e8c22"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:39:52.338597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.338557    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd92r\" (UniqueName: \"kubernetes.io/projected/a53c1506-7c95-4528-b79c-9c6fb05e8c22-kube-api-access-wd92r\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:52.338597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.338589    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-service-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:52.338597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.338603    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:52.338922 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.338615    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-oauth-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:52.338922 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.338625    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53c1506-7c95-4528-b79c-9c6fb05e8c22-oauth-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:52.338922 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.338634    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53c1506-7c95-4528-b79c-9c6fb05e8c22-console-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:39:52.992492 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.992458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7767d59bd-7lgb7" event={"ID":"a53c1506-7c95-4528-b79c-9c6fb05e8c22","Type":"ContainerDied","Data":"78a64ea93b1efe9dcaa1e8b19aba231d7bd0f6854b8543be7a696f47761ad6d9"}
Jul 20 15:39:52.992492 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.992483    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7767d59bd-7lgb7"
Jul 20 15:39:52.992957 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:52.992519    2569 scope.go:117] "RemoveContainer" containerID="54af4536676d75af1d4fda34cda931a06c0c8b9266c40e2052727f61df8d2205"
Jul 20 15:39:53.015795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:53.015767    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7767d59bd-7lgb7"]
Jul 20 15:39:53.020175 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:53.020152    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7767d59bd-7lgb7"]
Jul 20 15:39:53.443340 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:53.443308    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53c1506-7c95-4528-b79c-9c6fb05e8c22" path="/var/lib/kubelet/pods/a53c1506-7c95-4528-b79c-9c6fb05e8c22/volumes"
Jul 20 15:39:55.817212 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:39:55.817179    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-424gk"
Jul 20 15:40:01.981949 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:01.981883    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf95d485d-5zxtv" podUID="3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" containerName="console" containerID="cri-o://1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b" gracePeriod=15
Jul 20 15:40:02.260539 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.260513    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:40:02.319940 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.319903    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-trusted-ca-bundle\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.319959    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-oauth-serving-cert\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.319978    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-service-ca\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-serving-cert\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320035    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ftll\" (UniqueName: \"kubernetes.io/projected/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-kube-api-access-6ftll\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320073    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-config\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320097    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-oauth-config\") pod \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\" (UID: \"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d\") "
Jul 20 15:40:02.320521 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320360    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:02.320521 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320509    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:02.320679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320499    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:02.320679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.320563    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-config" (OuterVolumeSpecName: "console-config") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:02.322223 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.322187    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:02.322328 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.322270    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:02.322328 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.322306    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-kube-api-access-6ftll" (OuterVolumeSpecName: "kube-api-access-6ftll") pod "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" (UID: "3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d"). InnerVolumeSpecName "kube-api-access-6ftll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:40:02.420871 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420815    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-trusted-ca-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:02.420871 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420862    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-oauth-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:02.420871 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420872    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-service-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:02.420871 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420881    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:02.421759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420890    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ftll\" (UniqueName: \"kubernetes.io/projected/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-kube-api-access-6ftll\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:02.421759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420898    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:02.421759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:02.420906    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d-console-oauth-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:03.032983 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.032942    2569 generic.go:356] "Generic (PLEG): container finished" podID="3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" containerID="1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b" exitCode=0
Jul 20 15:40:03.033411 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.032991    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf95d485d-5zxtv"
Jul 20 15:40:03.033411 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.033007    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf95d485d-5zxtv" event={"ID":"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d","Type":"ContainerDied","Data":"1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b"}
Jul 20 15:40:03.033411 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.033057    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf95d485d-5zxtv" event={"ID":"3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d","Type":"ContainerDied","Data":"0e532a7f88d75d2b96c1e06c500fa147f2278fa57c39021a56287a840bc6d136"}
Jul 20 15:40:03.033411 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.033085    2569 scope.go:117] "RemoveContainer" containerID="1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b"
Jul 20 15:40:03.042397 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.042381    2569 scope.go:117] "RemoveContainer" containerID="1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b"
Jul 20 15:40:03.042639 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:03.042623    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b\": container with ID starting with 1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b not found: ID does not exist" containerID="1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b"
Jul 20 15:40:03.042677 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.042645    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b"} err="failed to get container status \"1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b\": rpc error: code = NotFound desc = could not find container \"1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b\": container with ID starting with 1bed092d632174eb7452a925968e25dfc2ee80454c8405c28bfd51fce7dd417b not found: ID does not exist"
Jul 20 15:40:03.055941 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.055916    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf95d485d-5zxtv"]
Jul 20 15:40:03.060912 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.060886    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf95d485d-5zxtv"]
Jul 20 15:40:03.442454 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:03.442369    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" path="/var/lib/kubelet/pods/3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d/volumes"
Jul 20 15:40:06.145505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:06.145475    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:40:06.149577 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:06.149553    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7f458df58f-59jvp"
Jul 20 15:40:15.057803 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.057737    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-58d7ddb55d-rc5n7" podUID="92e1b755-5690-4108-9f2a-85c8a11f3605" containerName="console" containerID="cri-o://d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3" gracePeriod=15
Jul 20 15:40:15.332454 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.332376    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:40:15.419158 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419123    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-oauth-config\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419158 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419164    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-658z9\" (UniqueName: \"kubernetes.io/projected/92e1b755-5690-4108-9f2a-85c8a11f3605-kube-api-access-658z9\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419221    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-service-ca\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419241    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-serving-cert\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419260    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-console-config\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419305    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-trusted-ca-bundle\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419327    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-oauth-serving-cert\") pod \"92e1b755-5690-4108-9f2a-85c8a11f3605\" (UID: \"92e1b755-5690-4108-9f2a-85c8a11f3605\") "
Jul 20 15:40:15.419741 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419708    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-service-ca" (OuterVolumeSpecName: "service-ca") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:15.419741 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419730    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-console-config" (OuterVolumeSpecName: "console-config") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:15.419950 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419752    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:15.420000 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.419983    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:15.421654 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.421631    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92e1b755-5690-4108-9f2a-85c8a11f3605-kube-api-access-658z9" (OuterVolumeSpecName: "kube-api-access-658z9") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "kube-api-access-658z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:40:15.421855 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.421804    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:15.421946 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.421824    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92e1b755-5690-4108-9f2a-85c8a11f3605" (UID: "92e1b755-5690-4108-9f2a-85c8a11f3605"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:15.520906 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520870    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-service-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:15.520906 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520902    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:15.521150 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520922    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-console-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:15.521150 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520930    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-trusted-ca-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:15.521150 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520939    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92e1b755-5690-4108-9f2a-85c8a11f3605-oauth-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:15.521150 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520947    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92e1b755-5690-4108-9f2a-85c8a11f3605-console-oauth-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:15.521150 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:15.520955    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-658z9\" (UniqueName: \"kubernetes.io/projected/92e1b755-5690-4108-9f2a-85c8a11f3605-kube-api-access-658z9\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:16.080803 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.080768    2569 generic.go:356] "Generic (PLEG): container finished" podID="92e1b755-5690-4108-9f2a-85c8a11f3605" containerID="d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3" exitCode=0
Jul 20 15:40:16.081232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.080827    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d7ddb55d-rc5n7"
Jul 20 15:40:16.081232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.080859    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d7ddb55d-rc5n7" event={"ID":"92e1b755-5690-4108-9f2a-85c8a11f3605","Type":"ContainerDied","Data":"d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3"}
Jul 20 15:40:16.081232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.080911    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d7ddb55d-rc5n7" event={"ID":"92e1b755-5690-4108-9f2a-85c8a11f3605","Type":"ContainerDied","Data":"30751e8042b7f71afc4a7d35966c4e1f6905deac2ae076cada33ed74134292f4"}
Jul 20 15:40:16.081232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.080930    2569 scope.go:117] "RemoveContainer" containerID="d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3"
Jul 20 15:40:16.088694 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.088676    2569 scope.go:117] "RemoveContainer" containerID="d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3"
Jul 20 15:40:16.089110 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:16.089065    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3\": container with ID starting with d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3 not found: ID does not exist" containerID="d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3"
Jul 20 15:40:16.089201 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.089122    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3"} err="failed to get container status \"d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3\": rpc error: code = NotFound desc = could not find container \"d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3\": container with ID starting with d5895a7eb3a34c777a09662a116e95d5fa7a374efe3b56b5835f21f99e597cc3 not found: ID does not exist"
Jul 20 15:40:16.102692 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.102665    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58d7ddb55d-rc5n7"]
Jul 20 15:40:16.104536 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:16.104511    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58d7ddb55d-rc5n7"]
Jul 20 15:40:17.442616 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:17.442580    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92e1b755-5690-4108-9f2a-85c8a11f3605" path="/var/lib/kubelet/pods/92e1b755-5690-4108-9f2a-85c8a11f3605/volumes"
Jul 20 15:40:41.923994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.923951    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:40:41.924518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.924259    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="alertmanager" containerID="cri-o://e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622" gracePeriod=120
Jul 20 15:40:41.924518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.924330    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-metric" containerID="cri-o://cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb" gracePeriod=120
Jul 20 15:40:41.924518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.924374    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="prom-label-proxy" containerID="cri-o://53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af" gracePeriod=120
Jul 20 15:40:41.924518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.924396    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="config-reloader" containerID="cri-o://b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4" gracePeriod=120
Jul 20 15:40:41.924518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.924418    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy" containerID="cri-o://67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682" gracePeriod=120
Jul 20 15:40:41.924518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:41.924376    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-web" containerID="cri-o://b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7" gracePeriod=120
Jul 20 15:40:42.179013 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.178933    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af" exitCode=0
Jul 20 15:40:42.179013 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.178958    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb" exitCode=0
Jul 20 15:40:42.179013 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.178964    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682" exitCode=0
Jul 20 15:40:42.179013 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.178971    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4" exitCode=0
Jul 20 15:40:42.179013 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.178976    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622" exitCode=0
Jul 20 15:40:42.179013 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.179007    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af"}
Jul 20 15:40:42.179295 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.179069    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb"}
Jul 20 15:40:42.179295 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.179095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682"}
Jul 20 15:40:42.179295 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.179120    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4"}
Jul 20 15:40:42.179295 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:42.179146    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622"}
Jul 20 15:40:43.171553 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.171528    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.184881 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.184850    2569 generic.go:356] "Generic (PLEG): container finished" podID="922b5507-1209-43eb-9e12-219b184d662b" containerID="b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7" exitCode=0
Jul 20 15:40:43.184986 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.184896    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7"}
Jul 20 15:40:43.184986 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.184919    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.184986 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.184950    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"922b5507-1209-43eb-9e12-219b184d662b","Type":"ContainerDied","Data":"aa113e21e84b7dba4b2895327257d5c852a81a4d11e4adf387f4f253d6b76f81"}
Jul 20 15:40:43.184986 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.184984    2569 scope.go:117] "RemoveContainer" containerID="53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af"
Jul 20 15:40:43.191894 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.191879    2569 scope.go:117] "RemoveContainer" containerID="cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb"
Jul 20 15:40:43.198505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.198489    2569 scope.go:117] "RemoveContainer" containerID="67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682"
Jul 20 15:40:43.207017 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.206944    2569 scope.go:117] "RemoveContainer" containerID="b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7"
Jul 20 15:40:43.215976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.215948    2569 scope.go:117] "RemoveContainer" containerID="b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4"
Jul 20 15:40:43.224306 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.224288    2569 scope.go:117] "RemoveContainer" containerID="e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622"
Jul 20 15:40:43.231523 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.231503    2569 scope.go:117] "RemoveContainer" containerID="b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e"
Jul 20 15:40:43.239781 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-config-out\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.239781 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239721    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ppzv\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-kube-api-access-9ppzv\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.239781 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239747    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-tls-assets\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.239781 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239775    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-cluster-tls-config\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239802    2569 scope.go:117] "RemoveContainer" containerID="53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af"
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239814    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239873    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239897    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-web-config\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.239974    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-main-tls\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240007    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-main-db\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240034 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240030    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-web\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.240613 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.240462    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af\": container with ID starting with 53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af not found: ID does not exist" containerID="53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af"
Jul 20 15:40:43.240613 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240508    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af"} err="failed to get container status \"53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af\": rpc error: code = NotFound desc = could not find container \"53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af\": container with ID starting with 53a71199eea3475974ae289834fd687a4efccfbfbc88a99bba0547339bcac9af not found: ID does not exist"
Jul 20 15:40:43.240613 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240534    2569 scope.go:117] "RemoveContainer" containerID="cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb"
Jul 20 15:40:43.240613 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240570    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-trusted-ca-bundle\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240636    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-config-volume\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240668    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-metrics-client-ca\") pod \"922b5507-1209-43eb-9e12-219b184d662b\" (UID: \"922b5507-1209-43eb-9e12-219b184d662b\") "
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.240957    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.241058    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb\": container with ID starting with cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb not found: ID does not exist" containerID="cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb"
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241149    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb"} err="failed to get container status \"cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb\": rpc error: code = NotFound desc = could not find container \"cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb\": container with ID starting with cd5ff5fa13ba17d7f67500bf16c41c3dcaf4860de8089d914de561393b1400cb not found: ID does not exist"
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241173    2569 scope.go:117] "RemoveContainer" containerID="67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682"
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241154    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:43.241419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241220    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:40:43.241827 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.241445    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682\": container with ID starting with 67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682 not found: ID does not exist" containerID="67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682"
Jul 20 15:40:43.241827 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241478    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682"} err="failed to get container status \"67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682\": rpc error: code = NotFound desc = could not find container \"67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682\": container with ID starting with 67fd5d697a4cfe6f7733fb09325c29f1843c7e7b997c2dbf110129e89f3e6682 not found: ID does not exist"
Jul 20 15:40:43.241827 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241501    2569 scope.go:117] "RemoveContainer" containerID="b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7"
Jul 20 15:40:43.241827 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.241757    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7\": container with ID starting with b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7 not found: ID does not exist" containerID="b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7"
Jul 20 15:40:43.241827 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241783    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7"} err="failed to get container status \"b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7\": rpc error: code = NotFound desc = could not find container \"b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7\": container with ID starting with b47b115912776ea106d3e7e0bef85e44b9ecd224733d353cbf8472bf035a55a7 not found: ID does not exist"
Jul 20 15:40:43.241827 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.241802    2569 scope.go:117] "RemoveContainer" containerID="b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4"
Jul 20 15:40:43.242152 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.242051    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4\": container with ID starting with b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4 not found: ID does not exist" containerID="b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4"
Jul 20 15:40:43.242152 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.242077    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4"} err="failed to get container status \"b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4\": rpc error: code = NotFound desc = could not find container \"b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4\": container with ID starting with b86bf01c26a37c7d7406a6d5b59a3b6c51b016bf29a8b44360166aba244f99c4 not found: ID does not exist"
Jul 20 15:40:43.242152 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.242098    2569 scope.go:117] "RemoveContainer" containerID="e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622"
Jul 20 15:40:43.242373 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.242323    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622\": container with ID starting with e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622 not found: ID does not exist" containerID="e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622"
Jul 20 15:40:43.242373 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.242348    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622"} err="failed to get container status \"e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622\": rpc error: code = NotFound desc = could not find container \"e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622\": container with ID starting with e26fc011a3f62669114f26269a08fe1915e6ec0f5148e46c6145b718ea5b7622 not found: ID does not exist"
Jul 20 15:40:43.242373 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.242367    2569 scope.go:117] "RemoveContainer" containerID="b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e"
Jul 20 15:40:43.242671 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:40:43.242643    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e\": container with ID starting with b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e not found: ID does not exist" containerID="b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e"
Jul 20 15:40:43.242737 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.242680    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e"} err="failed to get container status \"b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e\": rpc error: code = NotFound desc = could not find container \"b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e\": container with ID starting with b183415fcc0ea6fb57d44c4db896a09731e9860d1685f62e0b02f2777126270e not found: ID does not exist"
Jul 20 15:40:43.243568 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.243542    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.244469 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.244434    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.244978 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.244803    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.244978 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.244933    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-kube-api-access-9ppzv" (OuterVolumeSpecName: "kube-api-access-9ppzv") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "kube-api-access-9ppzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:40:43.245261 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.245063    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:40:43.245261 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.245207    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-config-out" (OuterVolumeSpecName: "config-out") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:40:43.245654 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.245627    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.245738 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.245710    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-config-volume" (OuterVolumeSpecName: "config-volume") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.249907 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.249884    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.255758 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.255734    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-web-config" (OuterVolumeSpecName: "web-config") pod "922b5507-1209-43eb-9e12-219b184d662b" (UID: "922b5507-1209-43eb-9e12-219b184d662b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:40:43.341731 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341694    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-main-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341731 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341730    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-main-db\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341744    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341756    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341770    2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-config-volume\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341782    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/922b5507-1209-43eb-9e12-219b184d662b-metrics-client-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341796    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/922b5507-1209-43eb-9e12-219b184d662b-config-out\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341807    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ppzv\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-kube-api-access-9ppzv\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341817    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/922b5507-1209-43eb-9e12-219b184d662b-tls-assets\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341828    2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-cluster-tls-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341864    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341877    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.341996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.341894    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/922b5507-1209-43eb-9e12-219b184d662b-web-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:40:43.508029 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.507999    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:40:43.513934 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.513909    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:40:43.546183 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546156    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:40:43.546406 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546394    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="init-config-reloader"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546407    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="init-config-reloader"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546414    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-metric"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546420    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-metric"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546430    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="alertmanager"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546437    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="alertmanager"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546444    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="config-reloader"
Jul 20 15:40:43.546448 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546449    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="config-reloader"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546455    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-web"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546460    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-web"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546467    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53c1506-7c95-4528-b79c-9c6fb05e8c22" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546472    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53c1506-7c95-4528-b79c-9c6fb05e8c22" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546478    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546483    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546489    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="prom-label-proxy"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546494    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="prom-label-proxy"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546504    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546508    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546514    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92e1b755-5690-4108-9f2a-85c8a11f3605" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546520    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="92e1b755-5690-4108-9f2a-85c8a11f3605" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546560    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-metric"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546568    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53c1506-7c95-4528-b79c-9c6fb05e8c22" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546573    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="config-reloader"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546579    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a5ad931-f98c-4c3b-9d10-f11c1aa14c0d" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546584    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546589    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="prom-label-proxy"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546595    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="alertmanager"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546600    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="92e1b755-5690-4108-9f2a-85c8a11f3605" containerName="console"
Jul 20 15:40:43.546643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.546605    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="922b5507-1209-43eb-9e12-219b184d662b" containerName="kube-rbac-proxy-web"
Jul 20 15:40:43.550268 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.550248    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.552306 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.552286    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 15:40:43.552694 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.552663    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 15:40:43.552694 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.552654    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 15:40:43.552924 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.552719    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 15:40:43.552924 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.552730    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 15:40:43.552924 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.552887    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-np45t\""
Jul 20 15:40:43.553112 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.553095    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 15:40:43.553191 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.553103    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 15:40:43.553333 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.553317    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 15:40:43.559802 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.559784    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 15:40:43.569163 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.569140    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:40:43.644100 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.644263 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/189027c4-b504-4bea-acdb-2a43e0bafa9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/189027c4-b504-4bea-acdb-2a43e0bafa9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/189027c4-b504-4bea-acdb-2a43e0bafa9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-web-config\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z47s\" (UniqueName: \"kubernetes.io/projected/189027c4-b504-4bea-acdb-2a43e0bafa9d-kube-api-access-8z47s\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/189027c4-b504-4bea-acdb-2a43e0bafa9d-config-out\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/189027c4-b504-4bea-acdb-2a43e0bafa9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.644978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.645007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.645043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.647674 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.645069    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/189027c4-b504-4bea-acdb-2a43e0bafa9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746718 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746489    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/189027c4-b504-4bea-acdb-2a43e0bafa9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746718 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/189027c4-b504-4bea-acdb-2a43e0bafa9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746718 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746528    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-web-config\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746718 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z47s\" (UniqueName: \"kubernetes.io/projected/189027c4-b504-4bea-acdb-2a43e0bafa9d-kube-api-access-8z47s\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746905 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/189027c4-b504-4bea-acdb-2a43e0bafa9d-config-out\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746905 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746905 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/189027c4-b504-4bea-acdb-2a43e0bafa9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.746905 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.747092 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746917    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.747092 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.747092 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.746972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.747458 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.747430    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/189027c4-b504-4bea-acdb-2a43e0bafa9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.747623 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.747597    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/189027c4-b504-4bea-acdb-2a43e0bafa9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.749495 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749463    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/189027c4-b504-4bea-acdb-2a43e0bafa9d-config-out\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.749599 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749573    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/189027c4-b504-4bea-acdb-2a43e0bafa9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.749712 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.749777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749762    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/189027c4-b504-4bea-acdb-2a43e0bafa9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.749877 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-web-config\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.749877 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749865    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.750035 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.749960    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.750194 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.750176    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.750274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.750256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.751488 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.751472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/189027c4-b504-4bea-acdb-2a43e0bafa9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.757261 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.757237    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z47s\" (UniqueName: \"kubernetes.io/projected/189027c4-b504-4bea-acdb-2a43e0bafa9d-kube-api-access-8z47s\") pod \"alertmanager-main-0\" (UID: \"189027c4-b504-4bea-acdb-2a43e0bafa9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:43.860193 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:43.860098    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 15:40:44.002259 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:44.002232    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 15:40:44.005467 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:40:44.005438    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189027c4_b504_4bea_acdb_2a43e0bafa9d.slice/crio-92fb213b0848adf94beac995e97d1fd0432af2e73b3d0003161782e9734e85ce WatchSource:0}: Error finding container 92fb213b0848adf94beac995e97d1fd0432af2e73b3d0003161782e9734e85ce: Status 404 returned error can't find the container with id 92fb213b0848adf94beac995e97d1fd0432af2e73b3d0003161782e9734e85ce
Jul 20 15:40:44.190162 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:44.190076    2569 generic.go:356] "Generic (PLEG): container finished" podID="189027c4-b504-4bea-acdb-2a43e0bafa9d" containerID="4a7b1853666c68be4a1efb538ba9f2318c0ef7afaf980f1f5ea38db17b81eac3" exitCode=0
Jul 20 15:40:44.190570 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:44.190164    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerDied","Data":"4a7b1853666c68be4a1efb538ba9f2318c0ef7afaf980f1f5ea38db17b81eac3"}
Jul 20 15:40:44.190570 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:44.190246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"92fb213b0848adf94beac995e97d1fd0432af2e73b3d0003161782e9734e85ce"}
Jul 20 15:40:45.197820 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.197783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"45c5b721126ec38b32fd42fe45eb2e412ed8831ed37ce324644fe28b8b768fea"}
Jul 20 15:40:45.198256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.197862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"69db60f07c3d71cd4b1131d404131a28d3da59ab9c6fe2f54609d53beca49b11"}
Jul 20 15:40:45.198256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.197889    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"682380fa7a5d41484957f164b67ec337a6bfacbfa692551368ea6fc8e2cff8e8"}
Jul 20 15:40:45.198256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.197915    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"9a054502a53f46ff2cbfadd44d341a8d811a5c191fd4e03e37139c598ae94022"}
Jul 20 15:40:45.198256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.197942    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"8be1aef7f9ea01791944775ace0168560ae20baef5f3ff9159e9200201583819"}
Jul 20 15:40:45.198256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.197966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"189027c4-b504-4bea-acdb-2a43e0bafa9d","Type":"ContainerStarted","Data":"83927eeb9cea8562e42c85c769ece08e409617036c99dd822c3edb3aa3294cff"}
Jul 20 15:40:45.227463 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.227413    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.212559321 podStartE2EDuration="2.227395399s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.836078ms" isStatefulPod=false podCreationTimestamp="2026-07-20 15:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:40:45.226075897 +0000 UTC m=+158.340925994" watchObservedRunningTime="2026-07-20 15:40:45.227395399 +0000 UTC m=+158.342245522"
Jul 20 15:40:45.442664 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:45.442628    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922b5507-1209-43eb-9e12-219b184d662b" path="/var/lib/kubelet/pods/922b5507-1209-43eb-9e12-219b184d662b/volumes"
Jul 20 15:40:46.809226 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.809189    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-868875d7d-c6fj7"]
Jul 20 15:40:46.812005 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.811982    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.826107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.826081    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868875d7d-c6fj7"]
Jul 20 15:40:46.972120 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685h2\" (UniqueName: \"kubernetes.io/projected/751ce428-b069-4217-904c-0687dcfa03bd-kube-api-access-685h2\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.972291 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972137    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-service-ca\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.972291 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972217    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-console-config\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.972291 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-serving-cert\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.972392 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-trusted-ca-bundle\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.972392 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-oauth-serving-cert\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:46.972392 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:46.972353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-oauth-config\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073473 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-console-config\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073473 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-serving-cert\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073473 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073454    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-trusted-ca-bundle\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073473 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-oauth-serving-cert\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073748 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-oauth-config\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073748 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685h2\" (UniqueName: \"kubernetes.io/projected/751ce428-b069-4217-904c-0687dcfa03bd-kube-api-access-685h2\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.073748 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.073576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-service-ca\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.074255 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.074229    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-oauth-serving-cert\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.074365 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.074268    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-console-config\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.074365 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.074356    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-service-ca\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.074443 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.074379    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-trusted-ca-bundle\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.075977 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.075946    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-oauth-config\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.076062 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.076016    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-serving-cert\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.084026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.084001    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-685h2\" (UniqueName: \"kubernetes.io/projected/751ce428-b069-4217-904c-0687dcfa03bd-kube-api-access-685h2\") pod \"console-868875d7d-c6fj7\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") " pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.120499 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.120464    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:47.254573 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:47.254549    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-868875d7d-c6fj7"]
Jul 20 15:40:47.256686 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:40:47.256660    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751ce428_b069_4217_904c_0687dcfa03bd.slice/crio-370bbbc049733d1b5c734c2beeeca6d53b04ec1a4092f2038077cac086903c2d WatchSource:0}: Error finding container 370bbbc049733d1b5c734c2beeeca6d53b04ec1a4092f2038077cac086903c2d: Status 404 returned error can't find the container with id 370bbbc049733d1b5c734c2beeeca6d53b04ec1a4092f2038077cac086903c2d
Jul 20 15:40:48.217854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:48.217799    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868875d7d-c6fj7" event={"ID":"751ce428-b069-4217-904c-0687dcfa03bd","Type":"ContainerStarted","Data":"9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612"}
Jul 20 15:40:48.218249 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:48.217885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868875d7d-c6fj7" event={"ID":"751ce428-b069-4217-904c-0687dcfa03bd","Type":"ContainerStarted","Data":"370bbbc049733d1b5c734c2beeeca6d53b04ec1a4092f2038077cac086903c2d"}
Jul 20 15:40:48.238425 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:48.238361    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-868875d7d-c6fj7" podStartSLOduration=2.238344499 podStartE2EDuration="2.238344499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:40:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:40:48.237457859 +0000 UTC m=+161.352307947" watchObservedRunningTime="2026-07-20 15:40:48.238344499 +0000 UTC m=+161.353194583"
Jul 20 15:40:57.120919 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:57.120877    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:57.121365 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:57.120939    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:57.125679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:57.125654    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:57.257322 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:57.257289    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:40:57.316462 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:40:57.316421    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c497dc7b7-bxx7g"]
Jul 20 15:41:22.336787 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.336727    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c497dc7b7-bxx7g" podUID="b85ca613-c443-4e8c-9c1a-7c08059d7962" containerName="console" containerID="cri-o://6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd" gracePeriod=15
Jul 20 15:41:22.578147 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.578122    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:41:22.656296 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656218    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-service-ca\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656296 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656251    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-config\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656296 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656278    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-trusted-ca-bundle\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656531 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656305    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-serving-cert\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656531 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656403    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f64xl\" (UniqueName: \"kubernetes.io/projected/b85ca613-c443-4e8c-9c1a-7c08059d7962-kube-api-access-f64xl\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656531 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656496    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-oauth-serving-cert\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656684 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656536    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-oauth-config\") pod \"b85ca613-c443-4e8c-9c1a-7c08059d7962\" (UID: \"b85ca613-c443-4e8c-9c1a-7c08059d7962\") "
Jul 20 15:41:22.656684 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656655    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-service-ca" (OuterVolumeSpecName: "service-ca") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:41:22.656792 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656685    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-config" (OuterVolumeSpecName: "console-config") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:41:22.656874 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656711    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:41:22.656874 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656802    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-service-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:22.656972 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.656889    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:41:22.658535 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.658508    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:41:22.658646 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.658557    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:41:22.658689 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.658653    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b85ca613-c443-4e8c-9c1a-7c08059d7962-kube-api-access-f64xl" (OuterVolumeSpecName: "kube-api-access-f64xl") pod "b85ca613-c443-4e8c-9c1a-7c08059d7962" (UID: "b85ca613-c443-4e8c-9c1a-7c08059d7962"). InnerVolumeSpecName "kube-api-access-f64xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:41:22.758136 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.758091    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f64xl\" (UniqueName: \"kubernetes.io/projected/b85ca613-c443-4e8c-9c1a-7c08059d7962-kube-api-access-f64xl\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:22.758136 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.758124    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-oauth-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:22.758136 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.758136    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-oauth-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:22.758136 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.758148    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:22.758402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.758160    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b85ca613-c443-4e8c-9c1a-7c08059d7962-trusted-ca-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:22.758402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:22.758170    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b85ca613-c443-4e8c-9c1a-7c08059d7962-console-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:41:23.350579 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.350543    2569 generic.go:356] "Generic (PLEG): container finished" podID="b85ca613-c443-4e8c-9c1a-7c08059d7962" containerID="6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd" exitCode=0
Jul 20 15:41:23.351033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.350594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c497dc7b7-bxx7g" event={"ID":"b85ca613-c443-4e8c-9c1a-7c08059d7962","Type":"ContainerDied","Data":"6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd"}
Jul 20 15:41:23.351033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.350603    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c497dc7b7-bxx7g"
Jul 20 15:41:23.351033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.350661    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c497dc7b7-bxx7g" event={"ID":"b85ca613-c443-4e8c-9c1a-7c08059d7962","Type":"ContainerDied","Data":"4a6b8a56c887bd7858f40c8e31b9da75de65e0667f3ae3ce87b3153951e8dc14"}
Jul 20 15:41:23.351033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.350681    2569 scope.go:117] "RemoveContainer" containerID="6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd"
Jul 20 15:41:23.359386 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.359365    2569 scope.go:117] "RemoveContainer" containerID="6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd"
Jul 20 15:41:23.359694 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:41:23.359674    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd\": container with ID starting with 6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd not found: ID does not exist" containerID="6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd"
Jul 20 15:41:23.359739 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.359704    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd"} err="failed to get container status \"6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd\": rpc error: code = NotFound desc = could not find container \"6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd\": container with ID starting with 6d8711d9c10731ed14a0bd4d3633c692e31a71536174c454aa6de003aec9f8cd not found: ID does not exist"
Jul 20 15:41:23.377130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.377097    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c497dc7b7-bxx7g"]
Jul 20 15:41:23.386383 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.386350    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c497dc7b7-bxx7g"]
Jul 20 15:41:23.442224 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:41:23.442191    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b85ca613-c443-4e8c-9c1a-7c08059d7962" path="/var/lib/kubelet/pods/b85ca613-c443-4e8c-9c1a-7c08059d7962/volumes"
Jul 20 15:43:07.288223 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:07.288198    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 15:43:09.011421 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.011385    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"]
Jul 20 15:43:09.013130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.011791    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b85ca613-c443-4e8c-9c1a-7c08059d7962" containerName="console"
Jul 20 15:43:09.013130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.011807    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b85ca613-c443-4e8c-9c1a-7c08059d7962" containerName="console"
Jul 20 15:43:09.013130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.011887    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b85ca613-c443-4e8c-9c1a-7c08059d7962" containerName="console"
Jul 20 15:43:09.013772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.013754    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:09.015690 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.015673    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-xnf7w\""
Jul 20 15:43:09.016171 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.016156    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 20 15:43:09.016268 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.016181    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 20 15:43:09.023579 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.023554    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"]
Jul 20 15:43:09.091432 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.091387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89s8\" (UniqueName: \"kubernetes.io/projected/7e1e4eba-8bf8-4e9f-91a7-f118d759f322-kube-api-access-s89s8\") pod \"feast-operator-controller-manager-55d4d5564d-lkx7s\" (UID: \"7e1e4eba-8bf8-4e9f-91a7-f118d759f322\") " pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:09.191948 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.191920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89s8\" (UniqueName: \"kubernetes.io/projected/7e1e4eba-8bf8-4e9f-91a7-f118d759f322-kube-api-access-s89s8\") pod \"feast-operator-controller-manager-55d4d5564d-lkx7s\" (UID: \"7e1e4eba-8bf8-4e9f-91a7-f118d759f322\") " pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:09.201532 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.201511    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89s8\" (UniqueName: \"kubernetes.io/projected/7e1e4eba-8bf8-4e9f-91a7-f118d759f322-kube-api-access-s89s8\") pod \"feast-operator-controller-manager-55d4d5564d-lkx7s\" (UID: \"7e1e4eba-8bf8-4e9f-91a7-f118d759f322\") " pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:09.323614 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.323510    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:09.454897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.454868    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"]
Jul 20 15:43:09.458794 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:43:09.458769    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1e4eba_8bf8_4e9f_91a7_f118d759f322.slice/crio-39b1c834b2ab127f119e59e6da5e87c90ed94e1fff34bcfa6a061cd403fd4c0e WatchSource:0}: Error finding container 39b1c834b2ab127f119e59e6da5e87c90ed94e1fff34bcfa6a061cd403fd4c0e: Status 404 returned error can't find the container with id 39b1c834b2ab127f119e59e6da5e87c90ed94e1fff34bcfa6a061cd403fd4c0e
Jul 20 15:43:09.460696 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.460682    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:43:09.729609 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:09.729528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s" event={"ID":"7e1e4eba-8bf8-4e9f-91a7-f118d759f322","Type":"ContainerStarted","Data":"39b1c834b2ab127f119e59e6da5e87c90ed94e1fff34bcfa6a061cd403fd4c0e"}
Jul 20 15:43:12.743506 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:12.743470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s" event={"ID":"7e1e4eba-8bf8-4e9f-91a7-f118d759f322","Type":"ContainerStarted","Data":"7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e"}
Jul 20 15:43:12.744012 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:12.743603    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:12.761261 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:12.761208    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s" podStartSLOduration=2.511852215 podStartE2EDuration="4.761191951s" totalImagesPullingTime="2.249339736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:43:12.760408595 +0000 UTC m=+305.875258682" watchObservedRunningTime="2026-07-20 15:43:12.761191951 +0000 UTC m=+305.876042039"
Jul 20 15:43:23.749479 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:23.749445    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:43:45.713506 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.713471    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"]
Jul 20 15:43:45.716568 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.716547    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.719182 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719021    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 20 15:43:45.719182 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719052    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g4vft\""
Jul 20 15:43:45.719182 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719068    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 20 15:43:45.719182 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719110    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 20 15:43:45.719182 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719051    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 20 15:43:45.719996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719800    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 20 15:43:45.719996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719823    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 15:43:45.719996 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.719907    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 15:43:45.728287 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.728263    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"]
Jul 20 15:43:45.798722 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.798681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-ui-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.798722 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.798726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.798971 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.798768    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1825000-4f14-4b69-b42f-d7905e0d6e3c-feast-data\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.798971 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.798787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n5d9\" (UniqueName: \"kubernetes.io/projected/e1825000-4f14-4b69-b42f-d7905e0d6e3c-kube-api-access-7n5d9\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.798971 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.798811    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.798971 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.798861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-online-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1825000-4f14-4b69-b42f-d7905e0d6e3c-feast-data\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n5d9\" (UniqueName: \"kubernetes.io/projected/e1825000-4f14-4b69-b42f-d7905e0d6e3c-kube-api-access-7n5d9\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900364    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-online-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-ui-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900518 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900471    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.900781 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:43:45.900597    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:43:45.900781 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:43:45.900653    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls podName:e1825000-4f14-4b69-b42f-d7905e0d6e3c nodeName:}" failed. No retries permitted until 2026-07-20 15:43:46.4006337 +0000 UTC m=+339.515483768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls") pod "feast-simple-feast-setup-f864c5dfd-c2c7m" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:43:45.900781 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.900717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1825000-4f14-4b69-b42f-d7905e0d6e3c-feast-data\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.903017 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.902998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-online-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.903130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.903039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.903130 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.903117    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-ui-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:45.912870 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:45.912821    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n5d9\" (UniqueName: \"kubernetes.io/projected/e1825000-4f14-4b69-b42f-d7905e0d6e3c-kube-api-access-7n5d9\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:46.404814 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:46.404776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:46.407242 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:46.407209    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-c2c7m\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:46.637279 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:46.637243    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:43:46.775136 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:46.775111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"]
Jul 20 15:43:46.776906 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:43:46.776877    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1825000_4f14_4b69_b42f_d7905e0d6e3c.slice/crio-c92f9999de1c19a760f92f4bcfe2d723e5916dc8048ab20dea1674b27fd5cb8a WatchSource:0}: Error finding container c92f9999de1c19a760f92f4bcfe2d723e5916dc8048ab20dea1674b27fd5cb8a: Status 404 returned error can't find the container with id c92f9999de1c19a760f92f4bcfe2d723e5916dc8048ab20dea1674b27fd5cb8a
Jul 20 15:43:46.865582 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:43:46.865546    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"c92f9999de1c19a760f92f4bcfe2d723e5916dc8048ab20dea1674b27fd5cb8a"}
Jul 20 15:44:16.992078 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:16.991968    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"3460c05f91aa0571544014b4e298575d89a2ee14b5f0ec2811b2a0adad021406"}
Jul 20 15:44:22.013339 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:22.013305    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerID="3460c05f91aa0571544014b4e298575d89a2ee14b5f0ec2811b2a0adad021406" exitCode=0
Jul 20 15:44:22.013802 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:22.013374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"3460c05f91aa0571544014b4e298575d89a2ee14b5f0ec2811b2a0adad021406"}
Jul 20 15:44:23.019315 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:23.019282    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"ddb5d5dc03d39d9aed74daf52be7ea51dbca82e659e361e54a0d9f24e960d2ae"}
Jul 20 15:44:28.042080 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:28.041990    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerID="ddb5d5dc03d39d9aed74daf52be7ea51dbca82e659e361e54a0d9f24e960d2ae" exitCode=0
Jul 20 15:44:28.042080 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:28.042063    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"ddb5d5dc03d39d9aed74daf52be7ea51dbca82e659e361e54a0d9f24e960d2ae"}
Jul 20 15:44:28.053135 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:28.053117    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 20 15:44:29.052489 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:29.052453    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"a89f6c63d1f5552b3aaf595be716b6593d3b4169d2693f60b5e5e4accd21999a"}
Jul 20 15:44:29.053081 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:29.053046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"676788441edfb8e34bcca3adb1b3cc54b12390e43b57191d6f50a02a4f4099f0"}
Jul 20 15:44:29.053179 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:29.053092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"f9ff1ad77ef4afa84526ce994c89eebf9f6295aae06e60ca486c0d60cf7200c4"}
Jul 20 15:44:29.053179 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:29.053112    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerStarted","Data":"d95758fde0a68582c122d566c6b6af03b7df3866737e29fdc77a369f9261160e"}
Jul 20 15:44:29.078724 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:29.078646    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podStartSLOduration=14.302372048 podStartE2EDuration="44.078624397s" totalImagesPullingTime="29.776252349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:44:29.078594419 +0000 UTC m=+382.193444539" watchObservedRunningTime="2026-07-20 15:44:29.078624397 +0000 UTC m=+382.193474483"
Jul 20 15:44:31.637662 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.637376    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:31.638202 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.637696    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:31.638202 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.637717    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:31.638202 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.637733    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:31.640011 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.639849    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
Jul 20 15:44:31.640011 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.639884    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 20 15:44:31.640011 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.639932    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 20 15:44:31.640011 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:31.639869    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused"
Jul 20 15:44:34.639139 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.639105    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.639604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.639291    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.639699 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.639676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.639807 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.639785    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.640136 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.640094    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.640269 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.640142    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.640269 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.640251    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.640372 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.640309    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.640406 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.640378    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:34.644628 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:34.644607    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:35.082933 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:35.082901    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:35.086354 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:35.086329    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:44:56.394549 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.394509    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b77f597-7grkf"]
Jul 20 15:44:56.431041 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.431009    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b77f597-7grkf"]
Jul 20 15:44:56.431190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.431134    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512459 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-serving-cert\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512459 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxhz\" (UniqueName: \"kubernetes.io/projected/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-kube-api-access-7nxhz\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-oauth-serving-cert\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-trusted-ca-bundle\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512579    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-config\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-service-ca\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.512807 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.512689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-oauth-config\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613532 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-serving-cert\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613532 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxhz\" (UniqueName: \"kubernetes.io/projected/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-kube-api-access-7nxhz\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-oauth-serving-cert\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-trusted-ca-bundle\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613645    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-config\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-service-ca\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.613789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.613718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-oauth-config\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.614517 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.614462    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-oauth-serving-cert\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.614676 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.614518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-service-ca\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.614676 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.614588    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-trusted-ca-bundle\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.614676 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.614591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-config\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.616103 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.616067    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-serving-cert\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.616222 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.616178    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-console-oauth-config\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.630348 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.630326    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxhz\" (UniqueName: \"kubernetes.io/projected/078841f8-3de9-4f5a-bf9e-58eea2e73eb6-kube-api-access-7nxhz\") pod \"console-85b77f597-7grkf\" (UID: \"078841f8-3de9-4f5a-bf9e-58eea2e73eb6\") " pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.740202 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.740112    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:44:56.872368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:56.872332    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b77f597-7grkf"]
Jul 20 15:44:56.875594 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:44:56.875567    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078841f8_3de9_4f5a_bf9e_58eea2e73eb6.slice/crio-3afdd5fe4f6998ea1a917362c0d2abc3bb6006356b2ce0874fcbd9a3df3faf5c WatchSource:0}: Error finding container 3afdd5fe4f6998ea1a917362c0d2abc3bb6006356b2ce0874fcbd9a3df3faf5c: Status 404 returned error can't find the container with id 3afdd5fe4f6998ea1a917362c0d2abc3bb6006356b2ce0874fcbd9a3df3faf5c
Jul 20 15:44:57.165446 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:57.165413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b77f597-7grkf" event={"ID":"078841f8-3de9-4f5a-bf9e-58eea2e73eb6","Type":"ContainerStarted","Data":"03f396051353857ae882749337d83703266ef1dd49f71181824faa950c4f7cad"}
Jul 20 15:44:57.165648 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:57.165462    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b77f597-7grkf" event={"ID":"078841f8-3de9-4f5a-bf9e-58eea2e73eb6","Type":"ContainerStarted","Data":"3afdd5fe4f6998ea1a917362c0d2abc3bb6006356b2ce0874fcbd9a3df3faf5c"}
Jul 20 15:44:57.189812 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:44:57.189757    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b77f597-7grkf" podStartSLOduration=1.1897391370000001 podStartE2EDuration="1.189739137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:44:57.1888723 +0000 UTC m=+410.303722386" watchObservedRunningTime="2026-07-20 15:44:57.189739137 +0000 UTC m=+410.304589222"
Jul 20 15:45:06.740903 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:06.740865    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:45:06.741431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:06.740923    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:45:06.745849 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:06.745806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:45:07.206237 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:07.206209    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85b77f597-7grkf"
Jul 20 15:45:07.266021 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:07.265989    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868875d7d-c6fj7"]
Jul 20 15:45:32.286374 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.286276    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-868875d7d-c6fj7" podUID="751ce428-b069-4217-904c-0687dcfa03bd" containerName="console" containerID="cri-o://9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612" gracePeriod=15
Jul 20 15:45:32.519975 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.519949    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:45:32.621568 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621477    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-trusted-ca-bundle\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.621568 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621530    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-oauth-config\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.621568 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621559    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-oauth-serving-cert\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.621879 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621585    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-685h2\" (UniqueName: \"kubernetes.io/projected/751ce428-b069-4217-904c-0687dcfa03bd-kube-api-access-685h2\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.621879 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621622    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-serving-cert\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.621879 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621669    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-console-config\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.621879 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621699    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-service-ca\") pod \"751ce428-b069-4217-904c-0687dcfa03bd\" (UID: \"751ce428-b069-4217-904c-0687dcfa03bd\") "
Jul 20 15:45:32.622085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.621945    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:45:32.622243 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.622185    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-console-config" (OuterVolumeSpecName: "console-config") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:45:32.622243 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.622225    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:45:32.622423 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.622358    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:45:32.623799 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.623780    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:45:32.623911 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.623855    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:45:32.623911 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.623892    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751ce428-b069-4217-904c-0687dcfa03bd-kube-api-access-685h2" (OuterVolumeSpecName: "kube-api-access-685h2") pod "751ce428-b069-4217-904c-0687dcfa03bd" (UID: "751ce428-b069-4217-904c-0687dcfa03bd"). InnerVolumeSpecName "kube-api-access-685h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:45:32.722597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722556    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-console-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:32.722597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722589    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-service-ca\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:32.722597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722598    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-trusted-ca-bundle\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:32.722597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722607    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-oauth-config\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:32.722896 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722616    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/751ce428-b069-4217-904c-0687dcfa03bd-oauth-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:32.722896 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722625    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-685h2\" (UniqueName: \"kubernetes.io/projected/751ce428-b069-4217-904c-0687dcfa03bd-kube-api-access-685h2\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:32.722896 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:32.722634    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/751ce428-b069-4217-904c-0687dcfa03bd-console-serving-cert\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:45:33.305527 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.305489    2569 generic.go:356] "Generic (PLEG): container finished" podID="751ce428-b069-4217-904c-0687dcfa03bd" containerID="9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612" exitCode=0
Jul 20 15:45:33.306026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.305535    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868875d7d-c6fj7" event={"ID":"751ce428-b069-4217-904c-0687dcfa03bd","Type":"ContainerDied","Data":"9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612"}
Jul 20 15:45:33.306026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.305536    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-868875d7d-c6fj7"
Jul 20 15:45:33.306026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.305585    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-868875d7d-c6fj7" event={"ID":"751ce428-b069-4217-904c-0687dcfa03bd","Type":"ContainerDied","Data":"370bbbc049733d1b5c734c2beeeca6d53b04ec1a4092f2038077cac086903c2d"}
Jul 20 15:45:33.306026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.305616    2569 scope.go:117] "RemoveContainer" containerID="9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612"
Jul 20 15:45:33.315769 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.315733    2569 scope.go:117] "RemoveContainer" containerID="9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612"
Jul 20 15:45:33.316188 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:45:33.316163    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612\": container with ID starting with 9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612 not found: ID does not exist" containerID="9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612"
Jul 20 15:45:33.316298 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.316206    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612"} err="failed to get container status \"9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612\": rpc error: code = NotFound desc = could not find container \"9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612\": container with ID starting with 9b701b6e1ebabf4ab9d19ca242542741a45d67ddbb4b8e99d3275ea9ee101612 not found: ID does not exist"
Jul 20 15:45:33.331889 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.331859    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-868875d7d-c6fj7"]
Jul 20 15:45:33.345566 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.345539    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-868875d7d-c6fj7"]
Jul 20 15:45:33.442814 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:33.442781    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751ce428-b069-4217-904c-0687dcfa03bd" path="/var/lib/kubelet/pods/751ce428-b069-4217-904c-0687dcfa03bd/volumes"
Jul 20 15:45:37.023855 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.023800    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"]
Jul 20 15:45:37.024277 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.024119    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="registry" containerID="cri-o://d95758fde0a68582c122d566c6b6af03b7df3866737e29fdc77a369f9261160e" gracePeriod=30
Jul 20 15:45:37.024277 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.024180    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="offline" containerID="cri-o://676788441edfb8e34bcca3adb1b3cc54b12390e43b57191d6f50a02a4f4099f0" gracePeriod=30
Jul 20 15:45:37.024277 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.024185    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online" containerID="cri-o://f9ff1ad77ef4afa84526ce994c89eebf9f6295aae06e60ca486c0d60cf7200c4" gracePeriod=30
Jul 20 15:45:37.024451 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.024159    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui" containerID="cri-o://a89f6c63d1f5552b3aaf595be716b6593d3b4169d2693f60b5e5e4accd21999a" gracePeriod=30
Jul 20 15:45:37.375014 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.374914    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"]
Jul 20 15:45:37.375530 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.375509    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751ce428-b069-4217-904c-0687dcfa03bd" containerName="console"
Jul 20 15:45:37.375609 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.375535    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="751ce428-b069-4217-904c-0687dcfa03bd" containerName="console"
Jul 20 15:45:37.375664 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.375614    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="751ce428-b069-4217-904c-0687dcfa03bd" containerName="console"
Jul 20 15:45:37.379626 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.379603    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.383544 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.383502    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jgt6t\""
Jul 20 15:45:37.395075 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.395051    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"]
Jul 20 15:45:37.462749 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.462717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3589142a-9d19-4e99-a7f7-d6dbf797915a-feast-data\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.462955 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.462782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.462955 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.462858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.462955 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.462895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-ui-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.463085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.462952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-online-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.463085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.462977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5wx6\" (UniqueName: \"kubernetes.io/projected/3589142a-9d19-4e99-a7f7-d6dbf797915a-kube-api-access-p5wx6\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3589142a-9d19-4e99-a7f7-d6dbf797915a-feast-data\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563853 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563853 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563637    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563853 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563667    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-ui-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563853 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-online-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563853 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563742    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5wx6\" (UniqueName: \"kubernetes.io/projected/3589142a-9d19-4e99-a7f7-d6dbf797915a-kube-api-access-p5wx6\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.563853 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:45:37.563769    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 15:45:37.564190 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:45:37.563870    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls podName:3589142a-9d19-4e99-a7f7-d6dbf797915a nodeName:}" failed. No retries permitted until 2026-07-20 15:45:38.06382513 +0000 UTC m=+451.178675211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls") pod "feast-simple-feast-setup-f864c5dfd-cwbwd" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 15:45:37.564190 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.563959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3589142a-9d19-4e99-a7f7-d6dbf797915a-feast-data\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.566561 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.566535    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-online-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.566665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.566653    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-registry-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.567147 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.567126    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-ui-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:37.575231 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:37.575201    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5wx6\" (UniqueName: \"kubernetes.io/projected/3589142a-9d19-4e99-a7f7-d6dbf797915a-kube-api-access-p5wx6\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:38.066818 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.066778    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:38.069267 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.069242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls\") pod \"feast-simple-feast-setup-f864c5dfd-cwbwd\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") " pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:38.299488 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.299428    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:38.330162 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.330081    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerID="a89f6c63d1f5552b3aaf595be716b6593d3b4169d2693f60b5e5e4accd21999a" exitCode=0
Jul 20 15:45:38.330162 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.330103    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerID="f9ff1ad77ef4afa84526ce994c89eebf9f6295aae06e60ca486c0d60cf7200c4" exitCode=0
Jul 20 15:45:38.330330 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.330160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"a89f6c63d1f5552b3aaf595be716b6593d3b4169d2693f60b5e5e4accd21999a"}
Jul 20 15:45:38.330330 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.330220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"f9ff1ad77ef4afa84526ce994c89eebf9f6295aae06e60ca486c0d60cf7200c4"}
Jul 20 15:45:38.440318 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:38.440289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"]
Jul 20 15:45:38.442276 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:45:38.442247    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3589142a_9d19_4e99_a7f7_d6dbf797915a.slice/crio-217704a440641b0b155fe215a809a61d5edf799fbeb5f6a9294e8014791a96b1 WatchSource:0}: Error finding container 217704a440641b0b155fe215a809a61d5edf799fbeb5f6a9294e8014791a96b1: Status 404 returned error can't find the container with id 217704a440641b0b155fe215a809a61d5edf799fbeb5f6a9294e8014791a96b1
Jul 20 15:45:39.336252 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:39.336220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"}
Jul 20 15:45:39.336643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:39.336264    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"217704a440641b0b155fe215a809a61d5edf799fbeb5f6a9294e8014791a96b1"}
Jul 20 15:45:44.358747 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:44.358720    2569 generic.go:356] "Generic (PLEG): container finished" podID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerID="0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03" exitCode=0
Jul 20 15:45:44.359138 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:44.358798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"}
Jul 20 15:45:44.644041 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:44.640604    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 20 15:45:45.083183 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:45.083149    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 20 15:45:45.364959 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:45.364872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"}
Jul 20 15:45:50.388051 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:50.388016    2569 generic.go:356] "Generic (PLEG): container finished" podID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerID="b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2" exitCode=0
Jul 20 15:45:50.388051 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:50.388055    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"}
Jul 20 15:45:51.398516 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:51.398467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"}
Jul 20 15:45:51.399019 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:51.398537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"}
Jul 20 15:45:51.399019 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:51.398559    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"}
Jul 20 15:45:51.399019 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:51.398580    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerStarted","Data":"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"}
Jul 20 15:45:51.425603 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:51.424933    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podStartSLOduration=14.424910675 podStartE2EDuration="14.424910675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:45:51.424450713 +0000 UTC m=+464.539300819" watchObservedRunningTime="2026-07-20 15:45:51.424910675 +0000 UTC m=+464.539760761"
Jul 20 15:45:53.300454 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.300412    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:53.301050 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.301025    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:53.301195 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.301058    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:53.301195 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.301078    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:53.302754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.302708    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused"
Jul 20 15:45:53.302754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.302730    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jul 20 15:45:53.302972 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.302770    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jul 20 15:45:53.302972 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:53.302714    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
Jul 20 15:45:54.640418 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:54.640368    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 20 15:45:55.083798 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:55.083739    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 20 15:45:56.301058 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.300636    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
Jul 20 15:45:56.301058 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.300641    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jul 20 15:45:56.301660 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.301640    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:56.302111 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.302085    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:56.302598 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.302578    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:56.418394 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.418361    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:56.425366 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.425339    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:56.428636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:56.428612    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:58.299759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:58.299723    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:58.299759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:58.299770    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:59.300416 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:59.300386    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:59.300809 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:59.300511    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:59.441971 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:59.441942    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:45:59.442135 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:45:59.442002    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:46:04.640433 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:04.640385    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 20 15:46:04.640944 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:04.640525    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:46:05.083563 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:05.083522    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 20 15:46:05.083754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:05.083649    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:46:07.469205 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.469172    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerID="676788441edfb8e34bcca3adb1b3cc54b12390e43b57191d6f50a02a4f4099f0" exitCode=137
Jul 20 15:46:07.469205 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.469198    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerID="d95758fde0a68582c122d566c6b6af03b7df3866737e29fdc77a369f9261160e" exitCode=137
Jul 20 15:46:07.469600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.469253    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"676788441edfb8e34bcca3adb1b3cc54b12390e43b57191d6f50a02a4f4099f0"}
Jul 20 15:46:07.469600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.469299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"d95758fde0a68582c122d566c6b6af03b7df3866737e29fdc77a369f9261160e"}
Jul 20 15:46:07.676625 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.676602    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:46:07.835504 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.835456    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n5d9\" (UniqueName: \"kubernetes.io/projected/e1825000-4f14-4b69-b42f-d7905e0d6e3c-kube-api-access-7n5d9\") pod \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") "
Jul 20 15:46:07.835504 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.835510    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-ui-tls\") pod \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") "
Jul 20 15:46:07.835772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.835528    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-online-tls\") pod \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") "
Jul 20 15:46:07.835772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.835565    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1825000-4f14-4b69-b42f-d7905e0d6e3c-feast-data\") pod \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") "
Jul 20 15:46:07.835772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.835582    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-offline-tls\") pod \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") "
Jul 20 15:46:07.835772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.835631    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls\") pod \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\" (UID: \"e1825000-4f14-4b69-b42f-d7905e0d6e3c\") "
Jul 20 15:46:07.836245 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.836211    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1825000-4f14-4b69-b42f-d7905e0d6e3c-feast-data" (OuterVolumeSpecName: "feast-data") pod "e1825000-4f14-4b69-b42f-d7905e0d6e3c" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:46:07.837920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.837891    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-online-tls" (OuterVolumeSpecName: "online-tls") pod "e1825000-4f14-4b69-b42f-d7905e0d6e3c" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:46:07.838037 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.837919    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1825000-4f14-4b69-b42f-d7905e0d6e3c-kube-api-access-7n5d9" (OuterVolumeSpecName: "kube-api-access-7n5d9") pod "e1825000-4f14-4b69-b42f-d7905e0d6e3c" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c"). InnerVolumeSpecName "kube-api-access-7n5d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:46:07.838037 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.837941    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e1825000-4f14-4b69-b42f-d7905e0d6e3c" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:46:07.838144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.838055    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e1825000-4f14-4b69-b42f-d7905e0d6e3c" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:46:07.838144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.838092    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1825000-4f14-4b69-b42f-d7905e0d6e3c" (UID: "e1825000-4f14-4b69-b42f-d7905e0d6e3c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:46:07.936715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.936665    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e1825000-4f14-4b69-b42f-d7905e0d6e3c-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:46:07.936715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.936709    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:46:07.936715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.936718    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:46:07.936715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.936728    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n5d9\" (UniqueName: \"kubernetes.io/projected/e1825000-4f14-4b69-b42f-d7905e0d6e3c-kube-api-access-7n5d9\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:46:07.936715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.936739    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:46:07.937039 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:07.936748    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e1825000-4f14-4b69-b42f-d7905e0d6e3c-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:46:08.475503 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.475471    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m" event={"ID":"e1825000-4f14-4b69-b42f-d7905e0d6e3c","Type":"ContainerDied","Data":"c92f9999de1c19a760f92f4bcfe2d723e5916dc8048ab20dea1674b27fd5cb8a"}
Jul 20 15:46:08.475503 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.475499    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"
Jul 20 15:46:08.476142 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.475524    2569 scope.go:117] "RemoveContainer" containerID="a89f6c63d1f5552b3aaf595be716b6593d3b4169d2693f60b5e5e4accd21999a"
Jul 20 15:46:08.484754 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.484736    2569 scope.go:117] "RemoveContainer" containerID="676788441edfb8e34bcca3adb1b3cc54b12390e43b57191d6f50a02a4f4099f0"
Jul 20 15:46:08.492600 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.492583    2569 scope.go:117] "RemoveContainer" containerID="f9ff1ad77ef4afa84526ce994c89eebf9f6295aae06e60ca486c0d60cf7200c4"
Jul 20 15:46:08.500449 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.500423    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"]
Jul 20 15:46:08.500582 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.500465    2569 scope.go:117] "RemoveContainer" containerID="d95758fde0a68582c122d566c6b6af03b7df3866737e29fdc77a369f9261160e"
Jul 20 15:46:08.506106 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.506075    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-c2c7m"]
Jul 20 15:46:08.509198 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.509182    2569 scope.go:117] "RemoveContainer" containerID="ddb5d5dc03d39d9aed74daf52be7ea51dbca82e659e361e54a0d9f24e960d2ae"
Jul 20 15:46:08.516325 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:08.516309    2569 scope.go:117] "RemoveContainer" containerID="3460c05f91aa0571544014b4e298575d89a2ee14b5f0ec2811b2a0adad021406"
Jul 20 15:46:09.442667 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:46:09.442638    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" path="/var/lib/kubelet/pods/e1825000-4f14-4b69-b42f-d7905e0d6e3c/volumes"
Jul 20 15:47:00.974760 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.974677    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"]
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975104    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975118    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975132    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="feast-apply"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975141    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="feast-apply"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975150    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975159    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975183    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="feast-init"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975191    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="feast-init"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975202    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="registry"
Jul 20 15:47:00.975208 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975209    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="registry"
Jul 20 15:47:00.975505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975226    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="offline"
Jul 20 15:47:00.975505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975234    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="offline"
Jul 20 15:47:00.975505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975299    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="offline"
Jul 20 15:47:00.975505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975307    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="registry"
Jul 20 15:47:00.975505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975315    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="online"
Jul 20 15:47:00.975505 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.975328    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1825000-4f14-4b69-b42f-d7905e0d6e3c" containerName="ui"
Jul 20 15:47:00.978798 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.978771    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:00.981077 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981026    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 20 15:47:00.981226 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981027    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 20 15:47:00.981226 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981027    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 20 15:47:00.981226 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981038    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mx5fh\""
Jul 20 15:47:00.981404 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981043    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 20 15:47:00.981506 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981480    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 20 15:47:00.981601 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981514    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 20 15:47:00.981742 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.981729    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 20 15:47:00.990289 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:00.990264    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"]
Jul 20 15:47:01.073200 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.073164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-feast-data\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.073384 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.073217    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-registry-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.073384 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.073259    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfmrg\" (UniqueName: \"kubernetes.io/projected/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-kube-api-access-mfmrg\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.073384 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.073291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.073384 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.073315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-offline-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.073384 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.073330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-online-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174092 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfmrg\" (UniqueName: \"kubernetes.io/projected/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-kube-api-access-mfmrg\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174099    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-offline-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174141    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-online-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174200    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-feast-data\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174280 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:47:01.174224    2569 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 20 15:47:01.174280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174243    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-registry-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174617 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:47:01.174301    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls podName:5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa nodeName:}" failed. No retries permitted until 2026-07-20 15:47:01.674278722 +0000 UTC m=+534.789128787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls") pod "feast-simple-feast-remote-setup-595946d86-8h8zl" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 20 15:47:01.174717 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174697    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-feast-data\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.174973 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.174956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-registry-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.176528 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.176508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-online-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.176977 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.176959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-offline-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.183671 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.183645    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfmrg\" (UniqueName: \"kubernetes.io/projected/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-kube-api-access-mfmrg\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.679364 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.679329    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.681772 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.681746    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls\") pod \"feast-simple-feast-remote-setup-595946d86-8h8zl\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:01.888475 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:01.888440    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:02.047428 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:02.047404    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"]
Jul 20 15:47:02.049498 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:47:02.049477    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e6e02f6_555e_4ba9_a7f0_c70db19ee5fa.slice/crio-126451213e9e6fe01466cec4a817308b3f9dbe5532873e8f09481b41276f63d2 WatchSource:0}: Error finding container 126451213e9e6fe01466cec4a817308b3f9dbe5532873e8f09481b41276f63d2: Status 404 returned error can't find the container with id 126451213e9e6fe01466cec4a817308b3f9dbe5532873e8f09481b41276f63d2
Jul 20 15:47:02.681697 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:02.681656    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerStarted","Data":"90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7"}
Jul 20 15:47:02.681697 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:02.681705    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerStarted","Data":"126451213e9e6fe01466cec4a817308b3f9dbe5532873e8f09481b41276f63d2"}
Jul 20 15:47:07.702244 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:07.702161    2569 generic.go:356] "Generic (PLEG): container finished" podID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerID="90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7" exitCode=0
Jul 20 15:47:07.702244 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:07.702233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerDied","Data":"90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7"}
Jul 20 15:47:08.708220 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:08.708182    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerStarted","Data":"249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd"}
Jul 20 15:47:14.734224 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:14.734187    2569 generic.go:356] "Generic (PLEG): container finished" podID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerID="249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd" exitCode=0
Jul 20 15:47:14.734599 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:14.734264    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerDied","Data":"249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd"}
Jul 20 15:47:14.737357 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:14.737332    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 20 15:47:15.742369 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:15.742329    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerStarted","Data":"2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f"}
Jul 20 15:47:15.742821 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:15.742390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerStarted","Data":"6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be"}
Jul 20 15:47:15.742821 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:15.742413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerStarted","Data":"e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea"}
Jul 20 15:47:15.770101 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:15.770035    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podStartSLOduration=15.770011741 podStartE2EDuration="15.770011741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:47:15.767736042 +0000 UTC m=+548.882586149" watchObservedRunningTime="2026-07-20 15:47:15.770011741 +0000 UTC m=+548.884861827"
Jul 20 15:47:16.888908 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:16.888868    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:16.889392 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:16.888932    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:16.889392 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:16.888949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:16.890998 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:16.890959    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Jul 20 15:47:16.891111 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:16.891016    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 20 15:47:16.891111 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:16.890956    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jul 20 15:47:19.889723 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:19.889677    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 20 15:47:19.890214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:19.889669    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jul 20 15:47:19.890214 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:19.889686    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Jul 20 15:47:21.888987 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:21.888939    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:21.889477 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:21.889039    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:21.889477 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:21.889088    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:22.890244 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:22.890216    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:22.890669 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:22.890461    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:22.896804 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:22.896781    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:23.782441 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:23.782411    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:23.782649 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:23.782469    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:47:23.786589 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:47:23.786567    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:48:26.237062 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.237023    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"]
Jul 20 15:48:26.239704 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.237264    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online" containerID="cri-o://e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea" gracePeriod=30
Jul 20 15:48:26.239704 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.237320    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="offline" containerID="cri-o://6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be" gracePeriod=30
Jul 20 15:48:26.239704 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.237315    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui" containerID="cri-o://2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f" gracePeriod=30
Jul 20 15:48:26.354554 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.354519    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"]
Jul 20 15:48:26.354819 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.354790    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="registry" containerID="cri-o://c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3" gracePeriod=30
Jul 20 15:48:26.354976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.354922    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="offline" containerID="cri-o://c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8" gracePeriod=30
Jul 20 15:48:26.354976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.354951    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online" containerID="cri-o://bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35" gracePeriod=30
Jul 20 15:48:26.355106 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.354922    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui" containerID="cri-o://d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131" gracePeriod=30
Jul 20 15:48:26.425972 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:26.425929    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jul 20 15:48:27.026141 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:27.026042    2569 generic.go:356] "Generic (PLEG): container finished" podID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerID="2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f" exitCode=0
Jul 20 15:48:27.026141 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:27.026114    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerDied","Data":"2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f"}
Jul 20 15:48:27.029143 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:27.029113    2569 generic.go:356] "Generic (PLEG): container finished" podID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerID="d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131" exitCode=0
Jul 20 15:48:27.029267 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:27.029180    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"}
Jul 20 15:48:28.035709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:28.035669    2569 generic.go:356] "Generic (PLEG): container finished" podID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerID="e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea" exitCode=0
Jul 20 15:48:28.036139 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:28.035746    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerDied","Data":"e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea"}
Jul 20 15:48:28.038413 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:28.038396    2569 generic.go:356] "Generic (PLEG): container finished" podID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerID="bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35" exitCode=0
Jul 20 15:48:28.038471 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:28.038456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"}
Jul 20 15:48:29.438317 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:29.438224    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jul 20 15:48:33.782963 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:33.782911    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jul 20 15:48:33.782963 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:33.782944    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 20 15:48:36.425720 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:36.425675    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jul 20 15:48:39.438324 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:39.438277    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jul 20 15:48:43.782574 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:43.782529    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jul 20 15:48:43.782979 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:43.782529    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 20 15:48:46.425853 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:46.425791    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jul 20 15:48:46.426250 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:46.425932    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:48:49.438256 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:49.438203    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
Jul 20 15:48:49.442887 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:49.442863    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:48:53.782801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:53.782755    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
Jul 20 15:48:53.782801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:53.782777    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 20 15:48:53.783316 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:53.782934    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:48:53.783316 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:53.782994    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:48:56.425612 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:56.425571    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
Jul 20 15:48:56.895481 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:56.895456    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:48:57.004682 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.004616    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:48:57.052373 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052346    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-feast-data\") pod \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") "
Jul 20 15:48:57.052548 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052404    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-registry-tls\") pod \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") "
Jul 20 15:48:57.052548 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052421    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-online-tls\") pod \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") "
Jul 20 15:48:57.052548 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052449    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-offline-tls\") pod \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") "
Jul 20 15:48:57.052548 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052482    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfmrg\" (UniqueName: \"kubernetes.io/projected/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-kube-api-access-mfmrg\") pod \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") "
Jul 20 15:48:57.052725 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052596    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls\") pod \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\" (UID: \"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa\") "
Jul 20 15:48:57.052802 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052772    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 15:48:57.052924 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052905    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.052981 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.052940    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-feast-data" (OuterVolumeSpecName: "feast-data") pod "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:48:57.054700 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.054669    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.054700 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.054694    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-online-tls" (OuterVolumeSpecName: "online-tls") pod "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.054999 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.054985    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-kube-api-access-mfmrg" (OuterVolumeSpecName: "kube-api-access-mfmrg") pod "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa"). InnerVolumeSpecName "kube-api-access-mfmrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:48:57.055044 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.055014    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" (UID: "5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.153368 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153341    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5wx6\" (UniqueName: \"kubernetes.io/projected/3589142a-9d19-4e99-a7f7-d6dbf797915a-kube-api-access-p5wx6\") pod \"3589142a-9d19-4e99-a7f7-d6dbf797915a\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") "
Jul 20 15:48:57.153559 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153392    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3589142a-9d19-4e99-a7f7-d6dbf797915a-feast-data\") pod \"3589142a-9d19-4e99-a7f7-d6dbf797915a\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") "
Jul 20 15:48:57.153559 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153423    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-registry-tls\") pod \"3589142a-9d19-4e99-a7f7-d6dbf797915a\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") "
Jul 20 15:48:57.153559 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153468    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls\") pod \"3589142a-9d19-4e99-a7f7-d6dbf797915a\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") "
Jul 20 15:48:57.153559 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153497    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-ui-tls\") pod \"3589142a-9d19-4e99-a7f7-d6dbf797915a\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") "
Jul 20 15:48:57.153775 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153733    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-online-tls\") pod \"3589142a-9d19-4e99-a7f7-d6dbf797915a\" (UID: \"3589142a-9d19-4e99-a7f7-d6dbf797915a\") "
Jul 20 15:48:57.154002 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.153966    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3589142a-9d19-4e99-a7f7-d6dbf797915a-feast-data" (OuterVolumeSpecName: "feast-data") pod "3589142a-9d19-4e99-a7f7-d6dbf797915a" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:48:57.154107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.154048    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.154107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.154066    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.154107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.154080    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfmrg\" (UniqueName: \"kubernetes.io/projected/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-kube-api-access-mfmrg\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.154107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.154093    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.154107 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.154106    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.155966 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.155940    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3589142a-9d19-4e99-a7f7-d6dbf797915a" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.156085 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156022    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3589142a-9d19-4e99-a7f7-d6dbf797915a-kube-api-access-p5wx6" (OuterVolumeSpecName: "kube-api-access-p5wx6") pod "3589142a-9d19-4e99-a7f7-d6dbf797915a" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a"). InnerVolumeSpecName "kube-api-access-p5wx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:48:57.156174 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156137    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-online-tls" (OuterVolumeSpecName: "online-tls") pod "3589142a-9d19-4e99-a7f7-d6dbf797915a" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.156225 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156169    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3589142a-9d19-4e99-a7f7-d6dbf797915a" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.156225 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156191    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3589142a-9d19-4e99-a7f7-d6dbf797915a" (UID: "3589142a-9d19-4e99-a7f7-d6dbf797915a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:48:57.156637 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156612    2569 generic.go:356] "Generic (PLEG): container finished" podID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerID="6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be" exitCode=137
Jul 20 15:48:57.156694 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156681    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"
Jul 20 15:48:57.156730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156685    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerDied","Data":"6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be"}
Jul 20 15:48:57.156730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156724    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl" event={"ID":"5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa","Type":"ContainerDied","Data":"126451213e9e6fe01466cec4a817308b3f9dbe5532873e8f09481b41276f63d2"}
Jul 20 15:48:57.156824 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.156742    2569 scope.go:117] "RemoveContainer" containerID="2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f"
Jul 20 15:48:57.159656 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.159634    2569 generic.go:356] "Generic (PLEG): container finished" podID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerID="c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8" exitCode=137
Jul 20 15:48:57.159656 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.159656    2569 generic.go:356] "Generic (PLEG): container finished" podID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerID="c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3" exitCode=137
Jul 20 15:48:57.159851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.159678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"}
Jul 20 15:48:57.159851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.159702    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"
Jul 20 15:48:57.159851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.159714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"}
Jul 20 15:48:57.159851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.159734    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd" event={"ID":"3589142a-9d19-4e99-a7f7-d6dbf797915a","Type":"ContainerDied","Data":"217704a440641b0b155fe215a809a61d5edf799fbeb5f6a9294e8014791a96b1"}
Jul 20 15:48:57.166637 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.166619    2569 scope.go:117] "RemoveContainer" containerID="6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be"
Jul 20 15:48:57.174430 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.174410    2569 scope.go:117] "RemoveContainer" containerID="e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea"
Jul 20 15:48:57.182305 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.182284    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"]
Jul 20 15:48:57.182827 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.182806    2569 scope.go:117] "RemoveContainer" containerID="249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd"
Jul 20 15:48:57.187057 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.187037    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-595946d86-8h8zl"]
Jul 20 15:48:57.191401 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.191387    2569 scope.go:117] "RemoveContainer" containerID="90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7"
Jul 20 15:48:57.198327 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.198313    2569 scope.go:117] "RemoveContainer" containerID="2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f"
Jul 20 15:48:57.198580 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.198562    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f\": container with ID starting with 2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f not found: ID does not exist" containerID="2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f"
Jul 20 15:48:57.198636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.198589    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f"} err="failed to get container status \"2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f\": rpc error: code = NotFound desc = could not find container \"2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f\": container with ID starting with 2de67c51b74307153b4aa6e2a877a484ecb3620ffd93ac00b167f6624631414f not found: ID does not exist"
Jul 20 15:48:57.198636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.198608    2569 scope.go:117] "RemoveContainer" containerID="6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be"
Jul 20 15:48:57.198827 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.198812    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be\": container with ID starting with 6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be not found: ID does not exist" containerID="6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be"
Jul 20 15:48:57.198884 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.198852    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be"} err="failed to get container status \"6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be\": rpc error: code = NotFound desc = could not find container \"6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be\": container with ID starting with 6876eaa14d76d5e1d9cb54cc4cd9777044ffbedca13e5a08a3e6fc8cdd4583be not found: ID does not exist"
Jul 20 15:48:57.198884 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.198870    2569 scope.go:117] "RemoveContainer" containerID="e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea"
Jul 20 15:48:57.199080 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.199062    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea\": container with ID starting with e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea not found: ID does not exist" containerID="e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea"
Jul 20 15:48:57.199131 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.199086    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea"} err="failed to get container status \"e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea\": rpc error: code = NotFound desc = could not find container \"e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea\": container with ID starting with e9080c8a673bf474472a23da0dce6fff2026332fda6884062c2b79f289d5f7ea not found: ID does not exist"
Jul 20 15:48:57.199131 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.199100    2569 scope.go:117] "RemoveContainer" containerID="249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd"
Jul 20 15:48:57.199294 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.199279    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd\": container with ID starting with 249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd not found: ID does not exist" containerID="249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd"
Jul 20 15:48:57.199353 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.199298    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd"} err="failed to get container status \"249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd\": rpc error: code = NotFound desc = could not find container \"249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd\": container with ID starting with 249ae0c1afc775be0bc9a170e90f29a45b0dd3b04d1d497ab1780a79edddd3cd not found: ID does not exist"
Jul 20 15:48:57.199353 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.199315    2569 scope.go:117] "RemoveContainer" containerID="90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7"
Jul 20 15:48:57.199630 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.199613    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7\": container with ID starting with 90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7 not found: ID does not exist" containerID="90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7"
Jul 20 15:48:57.199709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.199637    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7"} err="failed to get container status \"90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7\": rpc error: code = NotFound desc = could not find container \"90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7\": container with ID starting with 90c4b662817b06b1a0c0b7d7c7dee68e2d6b2d5429c6640a64a9888ef5ff44f7 not found: ID does not exist"
Jul 20 15:48:57.199709 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.199658    2569 scope.go:117] "RemoveContainer" containerID="d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"
Jul 20 15:48:57.201762 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.201742    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"]
Jul 20 15:48:57.207981 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.207961    2569 scope.go:117] "RemoveContainer" containerID="c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"
Jul 20 15:48:57.208236 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.208217    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-f864c5dfd-cwbwd"]
Jul 20 15:48:57.214801 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.214782    2569 scope.go:117] "RemoveContainer" containerID="bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"
Jul 20 15:48:57.221934 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.221905    2569 scope.go:117] "RemoveContainer" containerID="c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"
Jul 20 15:48:57.228857 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.228823    2569 scope.go:117] "RemoveContainer" containerID="b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"
Jul 20 15:48:57.235540 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.235520    2569 scope.go:117] "RemoveContainer" containerID="0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"
Jul 20 15:48:57.242283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242136    2569 scope.go:117] "RemoveContainer" containerID="d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"
Jul 20 15:48:57.242401 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.242385    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131\": container with ID starting with d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131 not found: ID does not exist" containerID="d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"
Jul 20 15:48:57.242444 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242408    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"} err="failed to get container status \"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131\": rpc error: code = NotFound desc = could not find container \"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131\": container with ID starting with d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131 not found: ID does not exist"
Jul 20 15:48:57.242444 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242430    2569 scope.go:117] "RemoveContainer" containerID="c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"
Jul 20 15:48:57.242671 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.242654    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8\": container with ID starting with c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8 not found: ID does not exist" containerID="c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"
Jul 20 15:48:57.242711 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242677    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"} err="failed to get container status \"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8\": rpc error: code = NotFound desc = could not find container \"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8\": container with ID starting with c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8 not found: ID does not exist"
Jul 20 15:48:57.242711 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242693    2569 scope.go:117] "RemoveContainer" containerID="bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"
Jul 20 15:48:57.242959 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.242942    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35\": container with ID starting with bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35 not found: ID does not exist" containerID="bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"
Jul 20 15:48:57.243009 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242965    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"} err="failed to get container status \"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35\": rpc error: code = NotFound desc = could not find container \"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35\": container with ID starting with bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35 not found: ID does not exist"
Jul 20 15:48:57.243009 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.242982    2569 scope.go:117] "RemoveContainer" containerID="c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"
Jul 20 15:48:57.243225 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.243206    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3\": container with ID starting with c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3 not found: ID does not exist" containerID="c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"
Jul 20 15:48:57.243269 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243229    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"} err="failed to get container status \"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3\": rpc error: code = NotFound desc = could not find container \"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3\": container with ID starting with c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3 not found: ID does not exist"
Jul 20 15:48:57.243269 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243244    2569 scope.go:117] "RemoveContainer" containerID="b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"
Jul 20 15:48:57.243476 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.243460    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2\": container with ID starting with b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2 not found: ID does not exist" containerID="b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"
Jul 20 15:48:57.243520 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243480    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"} err="failed to get container status \"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2\": rpc error: code = NotFound desc = could not find container \"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2\": container with ID starting with b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2 not found: ID does not exist"
Jul 20 15:48:57.243520 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243494    2569 scope.go:117] "RemoveContainer" containerID="0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"
Jul 20 15:48:57.243692 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:48:57.243677    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03\": container with ID starting with 0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03 not found: ID does not exist" containerID="0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"
Jul 20 15:48:57.243737 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243697    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"} err="failed to get container status \"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03\": rpc error: code = NotFound desc = could not find container \"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03\": container with ID starting with 0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03 not found: ID does not exist"
Jul 20 15:48:57.243737 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243710    2569 scope.go:117] "RemoveContainer" containerID="d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"
Jul 20 15:48:57.243950 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243933    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131"} err="failed to get container status \"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131\": rpc error: code = NotFound desc = could not find container \"d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131\": container with ID starting with d65e1582585b86eb8f40ae825e8f922ceae4df86fb44a604716672c6a87ed131 not found: ID does not exist"
Jul 20 15:48:57.244004 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.243952    2569 scope.go:117] "RemoveContainer" containerID="c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"
Jul 20 15:48:57.244204 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244182    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8"} err="failed to get container status \"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8\": rpc error: code = NotFound desc = could not find container \"c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8\": container with ID starting with c68e989c1a622ea05d7c8214e9b7a2611bf252cb0227ace826657c3ce476eed8 not found: ID does not exist"
Jul 20 15:48:57.244252 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244204    2569 scope.go:117] "RemoveContainer" containerID="bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"
Jul 20 15:48:57.244404 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244385    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35"} err="failed to get container status \"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35\": rpc error: code = NotFound desc = could not find container \"bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35\": container with ID starting with bb47bea30d44ad0bff6fcabd0298cff04323739469021c80541d463b1fdbcb35 not found: ID does not exist"
Jul 20 15:48:57.244404 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244403    2569 scope.go:117] "RemoveContainer" containerID="c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"
Jul 20 15:48:57.244598 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244582    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3"} err="failed to get container status \"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3\": rpc error: code = NotFound desc = could not find container \"c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3\": container with ID starting with c3a85994fc384bd9c39e40e43b8cfb8644b1f6b58ff93792d420c8400d7543c3 not found: ID does not exist"
Jul 20 15:48:57.244640 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244598    2569 scope.go:117] "RemoveContainer" containerID="b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"
Jul 20 15:48:57.244804 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244784    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2"} err="failed to get container status \"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2\": rpc error: code = NotFound desc = could not find container \"b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2\": container with ID starting with b0dc7561b8b02f62ee47c3e865ef166e68867c5016990029a214e3f5a31988e2 not found: ID does not exist"
Jul 20 15:48:57.244804 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.244804    2569 scope.go:117] "RemoveContainer" containerID="0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"
Jul 20 15:48:57.245056 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.245039    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03"} err="failed to get container status \"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03\": rpc error: code = NotFound desc = could not find container \"0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03\": container with ID starting with 0dc5a644b2436c846dfd32e60258e6439c338d506d729ec489ad34910b6a3c03 not found: ID does not exist"
Jul 20 15:48:57.254427 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.254411    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.254427 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.254428    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.254536 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.254436    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.254536 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.254445    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3589142a-9d19-4e99-a7f7-d6dbf797915a-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.254536 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.254452    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5wx6\" (UniqueName: \"kubernetes.io/projected/3589142a-9d19-4e99-a7f7-d6dbf797915a-kube-api-access-p5wx6\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.254536 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.254460    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3589142a-9d19-4e99-a7f7-d6dbf797915a-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:48:57.442425 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.442348    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" path="/var/lib/kubelet/pods/3589142a-9d19-4e99-a7f7-d6dbf797915a/volumes"
Jul 20 15:48:57.442949 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:48:57.442936    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" path="/var/lib/kubelet/pods/5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa/volumes"
Jul 20 15:49:09.570033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.569999    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-jg8fx"]
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570424    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="registry"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570442    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="registry"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570459    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="feast-init"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570467    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="feast-init"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570478    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="offline"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570486    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="offline"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570497    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570505    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570515    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui"
Jul 20 15:49:09.570522 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570523    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570535    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="feast-apply"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570543    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="feast-apply"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570553    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570561    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570572    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="feast-init"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570580    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="feast-init"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570592    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="feast-apply"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570600    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="feast-apply"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570619    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570629    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570641    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="offline"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570649    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="offline"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570740    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="ui"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570756    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="online"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570765    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="offline"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570773    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="online"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570779    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="ui"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570789    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3589142a-9d19-4e99-a7f7-d6dbf797915a" containerName="registry"
Jul 20 15:49:09.571281 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.570797    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e6e02f6-555e-4ba9-a7f0-c70db19ee5fa" containerName="offline"
Jul 20 15:49:09.575193 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.575173    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.577112 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.577092    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-qsz2b\""
Jul 20 15:49:09.577203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.577140    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 15:49:09.577402 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.577381    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 15:49:09.577495 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.577391    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 20 15:49:09.580612 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.580590    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-jg8fx"]
Jul 20 15:49:09.599457 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.599434    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-gbs4c"]
Jul 20 15:49:09.602788 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.602771    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:49:09.609374 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.609350    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-gbs4c"]
Jul 20 15:49:09.647544 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.647510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jmnr\" (UniqueName: \"kubernetes.io/projected/7f246bb7-3848-4eb1-80c7-2398dec5efbf-kube-api-access-8jmnr\") pod \"postgres-864846d4f5-jg8fx\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") " pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.647544 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.647543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7f246bb7-3848-4eb1-80c7-2398dec5efbf-postgresdata\") pod \"postgres-864846d4f5-jg8fx\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") " pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.647745 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.647564    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh7cm\" (UniqueName: \"kubernetes.io/projected/4004d490-0010-4856-87c1-3914accb7b52-kube-api-access-vh7cm\") pod \"redis-69bbd798b6-gbs4c\" (UID: \"4004d490-0010-4856-87c1-3914accb7b52\") " pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:49:09.748167 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.748132    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jmnr\" (UniqueName: \"kubernetes.io/projected/7f246bb7-3848-4eb1-80c7-2398dec5efbf-kube-api-access-8jmnr\") pod \"postgres-864846d4f5-jg8fx\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") " pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.748167 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.748170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7f246bb7-3848-4eb1-80c7-2398dec5efbf-postgresdata\") pod \"postgres-864846d4f5-jg8fx\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") " pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.748385 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.748194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh7cm\" (UniqueName: \"kubernetes.io/projected/4004d490-0010-4856-87c1-3914accb7b52-kube-api-access-vh7cm\") pod \"redis-69bbd798b6-gbs4c\" (UID: \"4004d490-0010-4856-87c1-3914accb7b52\") " pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:49:09.748542 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.748523    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7f246bb7-3848-4eb1-80c7-2398dec5efbf-postgresdata\") pod \"postgres-864846d4f5-jg8fx\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") " pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.758394 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.758367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jmnr\" (UniqueName: \"kubernetes.io/projected/7f246bb7-3848-4eb1-80c7-2398dec5efbf-kube-api-access-8jmnr\") pod \"postgres-864846d4f5-jg8fx\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") " pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.760616 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.760598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh7cm\" (UniqueName: \"kubernetes.io/projected/4004d490-0010-4856-87c1-3914accb7b52-kube-api-access-vh7cm\") pod \"redis-69bbd798b6-gbs4c\" (UID: \"4004d490-0010-4856-87c1-3914accb7b52\") " pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:49:09.893549 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.893446    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:49:09.911624 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:09.911600    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:49:10.036976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:10.036953    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-jg8fx"]
Jul 20 15:49:10.040016 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:49:10.039981    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f246bb7_3848_4eb1_80c7_2398dec5efbf.slice/crio-8f282eb73441e4851e4531d796a68abee8e5343fabf5533fc9e964eff84efa78 WatchSource:0}: Error finding container 8f282eb73441e4851e4531d796a68abee8e5343fabf5533fc9e964eff84efa78: Status 404 returned error can't find the container with id 8f282eb73441e4851e4531d796a68abee8e5343fabf5533fc9e964eff84efa78
Jul 20 15:49:10.042076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:10.042057    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:49:10.058524 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:10.058499    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-gbs4c"]
Jul 20 15:49:10.061594 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:49:10.061572    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4004d490_0010_4856_87c1_3914accb7b52.slice/crio-10dee198658c849fb826906c10485244d4b25af6bf6b3a96cb61e09ca849022c WatchSource:0}: Error finding container 10dee198658c849fb826906c10485244d4b25af6bf6b3a96cb61e09ca849022c: Status 404 returned error can't find the container with id 10dee198658c849fb826906c10485244d4b25af6bf6b3a96cb61e09ca849022c
Jul 20 15:49:10.213309 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:10.213208    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-gbs4c" event={"ID":"4004d490-0010-4856-87c1-3914accb7b52","Type":"ContainerStarted","Data":"10dee198658c849fb826906c10485244d4b25af6bf6b3a96cb61e09ca849022c"}
Jul 20 15:49:10.214284 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:10.214257    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-jg8fx" event={"ID":"7f246bb7-3848-4eb1-80c7-2398dec5efbf","Type":"ContainerStarted","Data":"8f282eb73441e4851e4531d796a68abee8e5343fabf5533fc9e964eff84efa78"}
Jul 20 15:49:12.225043 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:12.224934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-gbs4c" event={"ID":"4004d490-0010-4856-87c1-3914accb7b52","Type":"ContainerStarted","Data":"435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3"}
Jul 20 15:49:12.240727 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:12.240673    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-gbs4c" podStartSLOduration=1.5178410420000001 podStartE2EDuration="3.240655047s" totalImagesPullingTime="1.722814005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:49:12.238885099 +0000 UTC m=+665.353735184" watchObservedRunningTime="2026-07-20 15:49:12.240655047 +0000 UTC m=+665.355505135"
Jul 20 15:49:14.236227 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:14.236184    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-jg8fx" event={"ID":"7f246bb7-3848-4eb1-80c7-2398dec5efbf","Type":"ContainerStarted","Data":"2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b"}
Jul 20 15:49:14.253003 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:14.252950    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-jg8fx" podStartSLOduration=1.1807214560000001 podStartE2EDuration="5.252932393s" totalImagesPullingTime="4.072210937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:49:14.252736889 +0000 UTC m=+667.367586976" watchObservedRunningTime="2026-07-20 15:49:14.252932393 +0000 UTC m=+667.367782479"
Jul 20 15:49:18.202249 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.202208    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9499d95-q697q"]
Jul 20 15:49:18.206227 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.206202    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.208860 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.208489    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jul 20 15:49:18.208860 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.208507    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jul 20 15:49:18.208860 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.208567    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 20 15:49:18.208860 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.208567    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-wnlbb\""
Jul 20 15:49:18.208860 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.208650    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jul 20 15:49:18.218218 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.218191    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9499d95-q697q"]
Jul 20 15:49:18.317923 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.317885    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d8891d-8645-45a6-91a1-66d8f15ef697-feast-data\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.318132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.317937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.318132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.317965    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-online-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.318132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.318015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-offline-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.318132 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.318041    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mxz\" (UniqueName: \"kubernetes.io/projected/c8d8891d-8645-45a6-91a1-66d8f15ef697-kube-api-access-42mxz\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.418629 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.418592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d8891d-8645-45a6-91a1-66d8f15ef697-feast-data\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.418629 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.418634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.418923 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.418651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-online-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.418923 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.418697    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-offline-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.418923 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.418726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mxz\" (UniqueName: \"kubernetes.io/projected/c8d8891d-8645-45a6-91a1-66d8f15ef697-kube-api-access-42mxz\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.418923 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:49:18.418777    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Jul 20 15:49:18.418923 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:49:18.418871    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls podName:c8d8891d-8645-45a6-91a1-66d8f15ef697 nodeName:}" failed. No retries permitted until 2026-07-20 15:49:18.918828919 +0000 UTC m=+672.033679005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls") pod "feast-credit-scoring-84c9499d95-q697q" (UID: "c8d8891d-8645-45a6-91a1-66d8f15ef697") : secret "feast-credit-scoring-registry-tls" not found
Jul 20 15:49:18.419209 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.419098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d8891d-8645-45a6-91a1-66d8f15ef697-feast-data\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.421219 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.421187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-online-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.421315 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.421231    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-offline-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.428307 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.428269    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mxz\" (UniqueName: \"kubernetes.io/projected/c8d8891d-8645-45a6-91a1-66d8f15ef697-kube-api-access-42mxz\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.922312 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.922279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:18.924738 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:18.924711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls\") pod \"feast-credit-scoring-84c9499d95-q697q\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") " pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:19.118338 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:19.118291    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:19.260025 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:19.260001    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9499d95-q697q"]
Jul 20 15:49:19.261217 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:49:19.261197    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d8891d_8645_45a6_91a1_66d8f15ef697.slice/crio-bec089923bf65f25eb975203aa5d6b86fcf8c9e63ec223bb265f0209acfd601a WatchSource:0}: Error finding container bec089923bf65f25eb975203aa5d6b86fcf8c9e63ec223bb265f0209acfd601a: Status 404 returned error can't find the container with id bec089923bf65f25eb975203aa5d6b86fcf8c9e63ec223bb265f0209acfd601a
Jul 20 15:49:20.259980 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:20.259935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerStarted","Data":"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"}
Jul 20 15:49:20.260171 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:20.259996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerStarted","Data":"bec089923bf65f25eb975203aa5d6b86fcf8c9e63ec223bb265f0209acfd601a"}
Jul 20 15:49:21.264561 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:21.264528    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerID="a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a" exitCode=0
Jul 20 15:49:21.265023 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:21.264617    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerDied","Data":"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"}
Jul 20 15:49:22.270980 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:22.270947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerStarted","Data":"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"}
Jul 20 15:49:28.295407 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:28.295378    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerID="2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1" exitCode=0
Jul 20 15:49:28.295788 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:28.295450    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerDied","Data":"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"}
Jul 20 15:49:29.303043 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:29.303006    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerStarted","Data":"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"}
Jul 20 15:49:29.303558 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:29.303074    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerStarted","Data":"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"}
Jul 20 15:49:29.303558 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:29.303094    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerStarted","Data":"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"}
Jul 20 15:49:29.335569 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:29.331062    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podStartSLOduration=11.331031671 podStartE2EDuration="11.331031671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:49:29.32663417 +0000 UTC m=+682.441484279" watchObservedRunningTime="2026-07-20 15:49:29.331031671 +0000 UTC m=+682.445881759"
Jul 20 15:49:31.118897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:31.118849    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:31.119380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:31.118936    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:31.119380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:31.118974    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:31.120487 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:31.120452    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
Jul 20 15:49:31.120618 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:31.120478    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jul 20 15:49:31.120618 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:31.120501    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 20 15:49:34.119633 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:34.119586    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jul 20 15:49:34.120109 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:34.119671    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 20 15:49:34.120638 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:34.120615    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:34.121111 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:34.121085    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:34.121578 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:34.121561    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:37.119063 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:37.119014    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jul 20 15:49:37.126476 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:37.126447    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:37.126989 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:37.126960    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:37.131067 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:37.131041    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:39.119253 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:39.119206    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:40.119739 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:40.119710    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:49:40.355245 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:49:40.355218    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:50:44.873059 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.873022    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9499d95-q697q"]
Jul 20 15:50:44.873630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.873244    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry" containerID="cri-o://434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7" gracePeriod=30
Jul 20 15:50:44.873630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.873295    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="offline" containerID="cri-o://f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81" gracePeriod=30
Jul 20 15:50:44.873630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.873295    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online" containerID="cri-o://35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa" gracePeriod=30
Jul 20 15:50:44.892141 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.892102    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-jg8fx"]
Jul 20 15:50:44.892347 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.892324    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-jg8fx" podUID="7f246bb7-3848-4eb1-80c7-2398dec5efbf" containerName="postgres" containerID="cri-o://2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b" gracePeriod=30
Jul 20 15:50:44.902111 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.902030    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-gbs4c"]
Jul 20 15:50:44.902280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:44.902253    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-gbs4c" podUID="4004d490-0010-4856-87c1-3914accb7b52" containerName="redis" containerID="cri-o://435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3" gracePeriod=30
Jul 20 15:50:45.172911 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.172886    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:50:45.175644 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.175617    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:50:45.262877 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.262812    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7f246bb7-3848-4eb1-80c7-2398dec5efbf-postgresdata\") pod \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") "
Jul 20 15:50:45.292931 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.292891    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f246bb7-3848-4eb1-80c7-2398dec5efbf-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "7f246bb7-3848-4eb1-80c7-2398dec5efbf" (UID: "7f246bb7-3848-4eb1-80c7-2398dec5efbf"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:50:45.363795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.363766    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh7cm\" (UniqueName: \"kubernetes.io/projected/4004d490-0010-4856-87c1-3914accb7b52-kube-api-access-vh7cm\") pod \"4004d490-0010-4856-87c1-3914accb7b52\" (UID: \"4004d490-0010-4856-87c1-3914accb7b52\") "
Jul 20 15:50:45.363795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.363802    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jmnr\" (UniqueName: \"kubernetes.io/projected/7f246bb7-3848-4eb1-80c7-2398dec5efbf-kube-api-access-8jmnr\") pod \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\" (UID: \"7f246bb7-3848-4eb1-80c7-2398dec5efbf\") "
Jul 20 15:50:45.364026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.363956    2569 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/7f246bb7-3848-4eb1-80c7-2398dec5efbf-postgresdata\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:50:45.365972 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.365939    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f246bb7-3848-4eb1-80c7-2398dec5efbf-kube-api-access-8jmnr" (OuterVolumeSpecName: "kube-api-access-8jmnr") pod "7f246bb7-3848-4eb1-80c7-2398dec5efbf" (UID: "7f246bb7-3848-4eb1-80c7-2398dec5efbf"). InnerVolumeSpecName "kube-api-access-8jmnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:50:45.366094 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.365997    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4004d490-0010-4856-87c1-3914accb7b52-kube-api-access-vh7cm" (OuterVolumeSpecName: "kube-api-access-vh7cm") pod "4004d490-0010-4856-87c1-3914accb7b52" (UID: "4004d490-0010-4856-87c1-3914accb7b52"). InnerVolumeSpecName "kube-api-access-vh7cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:50:45.464766 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.464740    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh7cm\" (UniqueName: \"kubernetes.io/projected/4004d490-0010-4856-87c1-3914accb7b52-kube-api-access-vh7cm\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:50:45.464766 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.464765    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jmnr\" (UniqueName: \"kubernetes.io/projected/7f246bb7-3848-4eb1-80c7-2398dec5efbf-kube-api-access-8jmnr\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:50:45.622233 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.622200    2569 generic.go:356] "Generic (PLEG): container finished" podID="7f246bb7-3848-4eb1-80c7-2398dec5efbf" containerID="2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b" exitCode=0
Jul 20 15:50:45.622371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.622255    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-jg8fx"
Jul 20 15:50:45.622371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.622277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-jg8fx" event={"ID":"7f246bb7-3848-4eb1-80c7-2398dec5efbf","Type":"ContainerDied","Data":"2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b"}
Jul 20 15:50:45.622371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.622315    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-jg8fx" event={"ID":"7f246bb7-3848-4eb1-80c7-2398dec5efbf","Type":"ContainerDied","Data":"8f282eb73441e4851e4531d796a68abee8e5343fabf5533fc9e964eff84efa78"}
Jul 20 15:50:45.622371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.622332    2569 scope.go:117] "RemoveContainer" containerID="2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b"
Jul 20 15:50:45.623662 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.623645    2569 generic.go:356] "Generic (PLEG): container finished" podID="4004d490-0010-4856-87c1-3914accb7b52" containerID="435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3" exitCode=0
Jul 20 15:50:45.623744 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.623680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-gbs4c" event={"ID":"4004d490-0010-4856-87c1-3914accb7b52","Type":"ContainerDied","Data":"435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3"}
Jul 20 15:50:45.623744 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.623702    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-gbs4c" event={"ID":"4004d490-0010-4856-87c1-3914accb7b52","Type":"ContainerDied","Data":"10dee198658c849fb826906c10485244d4b25af6bf6b3a96cb61e09ca849022c"}
Jul 20 15:50:45.623744 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.623711    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-gbs4c"
Jul 20 15:50:45.639557 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.639532    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-gbs4c"]
Jul 20 15:50:45.644337 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.644313    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-gbs4c"]
Jul 20 15:50:45.655763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.655730    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-jg8fx"]
Jul 20 15:50:45.661882 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.661858    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-jg8fx"]
Jul 20 15:50:45.683399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.683382    2569 scope.go:117] "RemoveContainer" containerID="2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b"
Jul 20 15:50:45.683776 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:50:45.683758    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b\": container with ID starting with 2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b not found: ID does not exist" containerID="2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b"
Jul 20 15:50:45.683854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.683785    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b"} err="failed to get container status \"2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b\": rpc error: code = NotFound desc = could not find container \"2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b\": container with ID starting with 2d3768b77d3123d223bbcacf35953f7a5b5ba2b646da7e12a0369ce8cb81002b not found: ID does not exist"
Jul 20 15:50:45.683854 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.683804    2569 scope.go:117] "RemoveContainer" containerID="435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3"
Jul 20 15:50:45.691052 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.691028    2569 scope.go:117] "RemoveContainer" containerID="435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3"
Jul 20 15:50:45.691300 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:50:45.691279    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3\": container with ID starting with 435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3 not found: ID does not exist" containerID="435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3"
Jul 20 15:50:45.691442 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:45.691305    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3"} err="failed to get container status \"435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3\": rpc error: code = NotFound desc = could not find container \"435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3\": container with ID starting with 435cecd9fb3dfb34647c76d5db5d35cbd0d84abdd2b8b0e97debb48c6875f5a3 not found: ID does not exist"
Jul 20 15:50:46.630286 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:46.630252    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerID="35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa" exitCode=0
Jul 20 15:50:46.630734 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:46.630323    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerDied","Data":"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"}
Jul 20 15:50:47.127283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:47.127240    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 20 15:50:47.443002 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:47.442923    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4004d490-0010-4856-87c1-3914accb7b52" path="/var/lib/kubelet/pods/4004d490-0010-4856-87c1-3914accb7b52/volumes"
Jul 20 15:50:47.443290 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:47.443278    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f246bb7-3848-4eb1-80c7-2398dec5efbf" path="/var/lib/kubelet/pods/7f246bb7-3848-4eb1-80c7-2398dec5efbf/volumes"
Jul 20 15:50:57.127449 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:50:57.127400    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 20 15:51:07.127994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:07.127947    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 20 15:51:07.128493 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:07.128133    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:51:15.522210 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.522185    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:51:15.606063 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.606035    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d8891d-8645-45a6-91a1-66d8f15ef697-feast-data\") pod \"c8d8891d-8645-45a6-91a1-66d8f15ef697\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") "
Jul 20 15:51:15.606233 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.606079    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-offline-tls\") pod \"c8d8891d-8645-45a6-91a1-66d8f15ef697\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") "
Jul 20 15:51:15.606233 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.606149    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-online-tls\") pod \"c8d8891d-8645-45a6-91a1-66d8f15ef697\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") "
Jul 20 15:51:15.606233 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.606194    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls\") pod \"c8d8891d-8645-45a6-91a1-66d8f15ef697\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") "
Jul 20 15:51:15.606233 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.606232    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42mxz\" (UniqueName: \"kubernetes.io/projected/c8d8891d-8645-45a6-91a1-66d8f15ef697-kube-api-access-42mxz\") pod \"c8d8891d-8645-45a6-91a1-66d8f15ef697\" (UID: \"c8d8891d-8645-45a6-91a1-66d8f15ef697\") "
Jul 20 15:51:15.608270 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.608232    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8d8891d-8645-45a6-91a1-66d8f15ef697" (UID: "c8d8891d-8645-45a6-91a1-66d8f15ef697"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:51:15.608270 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.608267    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-online-tls" (OuterVolumeSpecName: "online-tls") pod "c8d8891d-8645-45a6-91a1-66d8f15ef697" (UID: "c8d8891d-8645-45a6-91a1-66d8f15ef697"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:51:15.608465 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.608447    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8d8891d-8645-45a6-91a1-66d8f15ef697-kube-api-access-42mxz" (OuterVolumeSpecName: "kube-api-access-42mxz") pod "c8d8891d-8645-45a6-91a1-66d8f15ef697" (UID: "c8d8891d-8645-45a6-91a1-66d8f15ef697"). InnerVolumeSpecName "kube-api-access-42mxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:51:15.608565 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.608551    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c8d8891d-8645-45a6-91a1-66d8f15ef697" (UID: "c8d8891d-8645-45a6-91a1-66d8f15ef697"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:51:15.615582 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.615552    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8d8891d-8645-45a6-91a1-66d8f15ef697-feast-data" (OuterVolumeSpecName: "feast-data") pod "c8d8891d-8645-45a6-91a1-66d8f15ef697" (UID: "c8d8891d-8645-45a6-91a1-66d8f15ef697"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:51:15.707127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.707044    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:51:15.707127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.707073    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42mxz\" (UniqueName: \"kubernetes.io/projected/c8d8891d-8645-45a6-91a1-66d8f15ef697-kube-api-access-42mxz\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:51:15.707127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.707082    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8d8891d-8645-45a6-91a1-66d8f15ef697-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:51:15.707127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.707090    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:51:15.707127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.707098    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8d8891d-8645-45a6-91a1-66d8f15ef697-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:51:15.742062 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742032    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerID="f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81" exitCode=137
Jul 20 15:51:15.742062 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742055    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerID="434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7" exitCode=137
Jul 20 15:51:15.742283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742096    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q"
Jul 20 15:51:15.742283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742111    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerDied","Data":"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"}
Jul 20 15:51:15.742283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742182    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerDied","Data":"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"}
Jul 20 15:51:15.742283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-84c9499d95-q697q" event={"ID":"c8d8891d-8645-45a6-91a1-66d8f15ef697","Type":"ContainerDied","Data":"bec089923bf65f25eb975203aa5d6b86fcf8c9e63ec223bb265f0209acfd601a"}
Jul 20 15:51:15.742283 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.742246    2569 scope.go:117] "RemoveContainer" containerID="f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"
Jul 20 15:51:15.750897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.750876    2569 scope.go:117] "RemoveContainer" containerID="35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"
Jul 20 15:51:15.758437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.758421    2569 scope.go:117] "RemoveContainer" containerID="434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"
Jul 20 15:51:15.764616 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.764593    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9499d95-q697q"]
Jul 20 15:51:15.766228 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.766211    2569 scope.go:117] "RemoveContainer" containerID="2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"
Jul 20 15:51:15.769796 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.769766    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-84c9499d95-q697q"]
Jul 20 15:51:15.774308 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.774282    2569 scope.go:117] "RemoveContainer" containerID="a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"
Jul 20 15:51:15.781274 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.781257    2569 scope.go:117] "RemoveContainer" containerID="f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"
Jul 20 15:51:15.781514 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:51:15.781499    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81\": container with ID starting with f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81 not found: ID does not exist" containerID="f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"
Jul 20 15:51:15.781560 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.781521    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"} err="failed to get container status \"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81\": rpc error: code = NotFound desc = could not find container \"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81\": container with ID starting with f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81 not found: ID does not exist"
Jul 20 15:51:15.781560 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.781538    2569 scope.go:117] "RemoveContainer" containerID="35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"
Jul 20 15:51:15.781788 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:51:15.781772    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa\": container with ID starting with 35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa not found: ID does not exist" containerID="35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"
Jul 20 15:51:15.781858 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.781791    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"} err="failed to get container status \"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa\": rpc error: code = NotFound desc = could not find container \"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa\": container with ID starting with 35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa not found: ID does not exist"
Jul 20 15:51:15.781858 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.781803    2569 scope.go:117] "RemoveContainer" containerID="434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"
Jul 20 15:51:15.782074 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:51:15.782057    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7\": container with ID starting with 434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7 not found: ID does not exist" containerID="434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"
Jul 20 15:51:15.782115 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782082    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"} err="failed to get container status \"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7\": rpc error: code = NotFound desc = could not find container \"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7\": container with ID starting with 434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7 not found: ID does not exist"
Jul 20 15:51:15.782115 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782099    2569 scope.go:117] "RemoveContainer" containerID="2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"
Jul 20 15:51:15.782355 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:51:15.782338    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1\": container with ID starting with 2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1 not found: ID does not exist" containerID="2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"
Jul 20 15:51:15.782408 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782362    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"} err="failed to get container status \"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1\": rpc error: code = NotFound desc = could not find container \"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1\": container with ID starting with 2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1 not found: ID does not exist"
Jul 20 15:51:15.782408 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782379    2569 scope.go:117] "RemoveContainer" containerID="a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"
Jul 20 15:51:15.782616 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:51:15.782600    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a\": container with ID starting with a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a not found: ID does not exist" containerID="a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"
Jul 20 15:51:15.782658 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782619    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"} err="failed to get container status \"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a\": rpc error: code = NotFound desc = could not find container \"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a\": container with ID starting with a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a not found: ID does not exist"
Jul 20 15:51:15.782658 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782632    2569 scope.go:117] "RemoveContainer" containerID="f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"
Jul 20 15:51:15.782857 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782821    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81"} err="failed to get container status \"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81\": rpc error: code = NotFound desc = could not find container \"f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81\": container with ID starting with f6618e4a24ef6d690240e3c4d5779e19bac3c80c3412a2bd507ecf431d998d81 not found: ID does not exist"
Jul 20 15:51:15.782918 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.782859    2569 scope.go:117] "RemoveContainer" containerID="35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"
Jul 20 15:51:15.783065 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783047    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa"} err="failed to get container status \"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa\": rpc error: code = NotFound desc = could not find container \"35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa\": container with ID starting with 35c5dad8a74b4a05d7ad2e7fe1888684f55f45ee2ec6ad6b816b3bbd1df470fa not found: ID does not exist"
Jul 20 15:51:15.783142 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783065    2569 scope.go:117] "RemoveContainer" containerID="434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"
Jul 20 15:51:15.783260 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783246    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7"} err="failed to get container status \"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7\": rpc error: code = NotFound desc = could not find container \"434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7\": container with ID starting with 434cf3239e10f247cc17f33da0c00bb86c3c2823eec68ce02812f04e0be2e8d7 not found: ID does not exist"
Jul 20 15:51:15.783301 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783261    2569 scope.go:117] "RemoveContainer" containerID="2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"
Jul 20 15:51:15.783516 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783497    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1"} err="failed to get container status \"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1\": rpc error: code = NotFound desc = could not find container \"2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1\": container with ID starting with 2746ed92a35f232a655f7f7ac03180a1de849828302733fdad191e00e53514d1 not found: ID does not exist"
Jul 20 15:51:15.783564 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783517    2569 scope.go:117] "RemoveContainer" containerID="a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"
Jul 20 15:51:15.783741 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:15.783722    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a"} err="failed to get container status \"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a\": rpc error: code = NotFound desc = could not find container \"a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a\": container with ID starting with a9cc4a148d6ae3d8797f5f7aa2b4b723f67a274f08f2966e1dcb37639ccac25a not found: ID does not exist"
Jul 20 15:51:17.442168 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:51:17.442136    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" path="/var/lib/kubelet/pods/c8d8891d-8645-45a6-91a1-66d8f15ef697/volumes"
Jul 20 15:53:19.731011 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.730977    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xts5j"]
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731232    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f246bb7-3848-4eb1-80c7-2398dec5efbf" containerName="postgres"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731243    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f246bb7-3848-4eb1-80c7-2398dec5efbf" containerName="postgres"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731255    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731260    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731268    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="feast-init"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731274    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="feast-init"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731280    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="offline"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731285    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="offline"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731292    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="feast-apply"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731296    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="feast-apply"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731306    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731311    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731317    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4004d490-0010-4856-87c1-3914accb7b52" containerName="redis"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731323    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4004d490-0010-4856-87c1-3914accb7b52" containerName="redis"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731366    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="online"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731373    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="registry"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731379    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8d8891d-8645-45a6-91a1-66d8f15ef697" containerName="offline"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731384    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4004d490-0010-4856-87c1-3914accb7b52" containerName="redis"
Jul 20 15:53:19.731399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.731390    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f246bb7-3848-4eb1-80c7-2398dec5efbf" containerName="postgres"
Jul 20 15:53:19.733175 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.733157    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:53:19.736074 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.736047    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jul 20 15:53:19.736347 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.736331    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jul 20 15:53:19.736443 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.736421    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-bts8s\""
Jul 20 15:53:19.774983 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.774946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssj7d\" (UniqueName: \"kubernetes.io/projected/21056a70-5dfc-4dd8-9364-05f5b6f9a010-kube-api-access-ssj7d\") pod \"redis-69bbd798b6-xts5j\" (UID: \"21056a70-5dfc-4dd8-9364-05f5b6f9a010\") " pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:53:19.788203 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.788174    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xts5j"]
Jul 20 15:53:19.875487 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.875455    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssj7d\" (UniqueName: \"kubernetes.io/projected/21056a70-5dfc-4dd8-9364-05f5b6f9a010-kube-api-access-ssj7d\") pod \"redis-69bbd798b6-xts5j\" (UID: \"21056a70-5dfc-4dd8-9364-05f5b6f9a010\") " pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:53:19.885267 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:19.885228    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssj7d\" (UniqueName: \"kubernetes.io/projected/21056a70-5dfc-4dd8-9364-05f5b6f9a010-kube-api-access-ssj7d\") pod \"redis-69bbd798b6-xts5j\" (UID: \"21056a70-5dfc-4dd8-9364-05f5b6f9a010\") " pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:53:20.055608 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:20.055567    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:53:20.185080 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:20.185049    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xts5j"]
Jul 20 15:53:20.187659 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:53:20.187634    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21056a70_5dfc_4dd8_9364_05f5b6f9a010.slice/crio-5627539c80e8dbf5cdd9ed0a5139e9db8008424716a52dc687e8c7437862c2f5 WatchSource:0}: Error finding container 5627539c80e8dbf5cdd9ed0a5139e9db8008424716a52dc687e8c7437862c2f5: Status 404 returned error can't find the container with id 5627539c80e8dbf5cdd9ed0a5139e9db8008424716a52dc687e8c7437862c2f5
Jul 20 15:53:20.198018 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:20.197993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j" event={"ID":"21056a70-5dfc-4dd8-9364-05f5b6f9a010","Type":"ContainerStarted","Data":"5627539c80e8dbf5cdd9ed0a5139e9db8008424716a52dc687e8c7437862c2f5"}
Jul 20 15:53:21.203250 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:21.203217    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j" event={"ID":"21056a70-5dfc-4dd8-9364-05f5b6f9a010","Type":"ContainerStarted","Data":"252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8"}
Jul 20 15:53:21.224976 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:21.224926    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j" podStartSLOduration=2.224908817 podStartE2EDuration="2.224908817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:53:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:53:21.223700769 +0000 UTC m=+914.338550854" watchObservedRunningTime="2026-07-20 15:53:21.224908817 +0000 UTC m=+914.339758901"
Jul 20 15:53:25.186188 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.186159    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-296hr"]
Jul 20 15:53:25.188688 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.188661    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.192041 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.192018    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jul 20 15:53:25.197864 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.197822    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-296hr"]
Jul 20 15:53:25.318432 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.318394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-postgresdata\") pod \"postgres-864846d4f5-296hr\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") " pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.318612 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.318510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfdh\" (UniqueName: \"kubernetes.io/projected/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-kube-api-access-jtfdh\") pod \"postgres-864846d4f5-296hr\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") " pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.419713 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.419677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfdh\" (UniqueName: \"kubernetes.io/projected/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-kube-api-access-jtfdh\") pod \"postgres-864846d4f5-296hr\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") " pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.419851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.419734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-postgresdata\") pod \"postgres-864846d4f5-296hr\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") " pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.420088 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.420072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-postgresdata\") pod \"postgres-864846d4f5-296hr\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") " pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.429694 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.429664    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfdh\" (UniqueName: \"kubernetes.io/projected/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-kube-api-access-jtfdh\") pod \"postgres-864846d4f5-296hr\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") " pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.498763 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.498686    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:53:25.633241 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:25.633210    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-296hr"]
Jul 20 15:53:25.636489 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:53:25.636466    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cd37187_7c99_4c38_acf3_5b5e2d9e907f.slice/crio-501ae1bf39a31f4d79781ecc88cd7c430d65c5c1c5a25eb11558be21472d38d7 WatchSource:0}: Error finding container 501ae1bf39a31f4d79781ecc88cd7c430d65c5c1c5a25eb11558be21472d38d7: Status 404 returned error can't find the container with id 501ae1bf39a31f4d79781ecc88cd7c430d65c5c1c5a25eb11558be21472d38d7
Jul 20 15:53:26.223737 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:26.223703    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-296hr" event={"ID":"9cd37187-7c99-4c38-acf3-5b5e2d9e907f","Type":"ContainerStarted","Data":"2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158"}
Jul 20 15:53:26.224165 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:26.223753    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-296hr" event={"ID":"9cd37187-7c99-4c38-acf3-5b5e2d9e907f","Type":"ContainerStarted","Data":"501ae1bf39a31f4d79781ecc88cd7c430d65c5c1c5a25eb11558be21472d38d7"}
Jul 20 15:53:26.244296 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:26.244174    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-296hr" podStartSLOduration=1.244150061 podStartE2EDuration="1.244150061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:53:26.243525678 +0000 UTC m=+919.358375764" watchObservedRunningTime="2026-07-20 15:53:26.244150061 +0000 UTC m=+919.359000152"
Jul 20 15:53:30.938631 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.938591    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"]
Jul 20 15:53:30.942149 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.942129    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:30.944293 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.944272    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 20 15:53:30.944640 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.944619    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jul 20 15:53:30.945024 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.945009    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jul 20 15:53:30.945254 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.945240    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-lfz8v\""
Jul 20 15:53:30.954451 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:30.954428    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"]
Jul 20 15:53:31.065984 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.065937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/640b04b3-190d-4b92-b22e-20d9e373034c-feast-data\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.066164 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.065996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz5zv\" (UniqueName: \"kubernetes.io/projected/640b04b3-190d-4b92-b22e-20d9e373034c-kube-api-access-hz5zv\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.066164 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.066029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-registry-tls\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.066164 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.066046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-online-tls\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.166678 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.166642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/640b04b3-190d-4b92-b22e-20d9e373034c-feast-data\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.166925 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.166692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz5zv\" (UniqueName: \"kubernetes.io/projected/640b04b3-190d-4b92-b22e-20d9e373034c-kube-api-access-hz5zv\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.166925 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.166717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-registry-tls\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.166925 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.166734    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-online-tls\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.167193 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.167170    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/640b04b3-190d-4b92-b22e-20d9e373034c-feast-data\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.169134 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.169117    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-registry-tls\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.169205 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.169147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-online-tls\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.176883 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.176858    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz5zv\" (UniqueName: \"kubernetes.io/projected/640b04b3-190d-4b92-b22e-20d9e373034c-kube-api-access-hz5zv\") pod \"feast-credit-scoring-75ff6549c-vjtgv\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") " pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.253099 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.253071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:31.391270 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:31.391237    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"]
Jul 20 15:53:31.394453 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:53:31.394430    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640b04b3_190d_4b92_b22e_20d9e373034c.slice/crio-03cf12e7697dcf7e361218b4075f8225dd6e8b05c746e6b365a425ea20573273 WatchSource:0}: Error finding container 03cf12e7697dcf7e361218b4075f8225dd6e8b05c746e6b365a425ea20573273: Status 404 returned error can't find the container with id 03cf12e7697dcf7e361218b4075f8225dd6e8b05c746e6b365a425ea20573273
Jul 20 15:53:32.247900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:32.247863    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerStarted","Data":"ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6"}
Jul 20 15:53:32.248424 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:32.247914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerStarted","Data":"03cf12e7697dcf7e361218b4075f8225dd6e8b05c746e6b365a425ea20573273"}
Jul 20 15:53:33.253606 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:33.253571    2569 generic.go:356] "Generic (PLEG): container finished" podID="640b04b3-190d-4b92-b22e-20d9e373034c" containerID="ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6" exitCode=0
Jul 20 15:53:33.254092 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:33.253626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerDied","Data":"ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6"}
Jul 20 15:53:34.259873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:34.259827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerStarted","Data":"03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4"}
Jul 20 15:53:41.290232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:41.290195    2569 generic.go:356] "Generic (PLEG): container finished" podID="640b04b3-190d-4b92-b22e-20d9e373034c" containerID="03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4" exitCode=0
Jul 20 15:53:41.290636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:41.290263    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerDied","Data":"03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4"}
Jul 20 15:53:42.298359 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:42.298322    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerStarted","Data":"bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc"}
Jul 20 15:53:42.298730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:42.298390    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerStarted","Data":"af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850"}
Jul 20 15:53:42.319828 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:42.319767    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podStartSLOduration=12.319745847 podStartE2EDuration="12.319745847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:53:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:53:42.319478508 +0000 UTC m=+935.434328625" watchObservedRunningTime="2026-07-20 15:53:42.319745847 +0000 UTC m=+935.434595934"
Jul 20 15:53:43.254112 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:43.254063    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:43.254341 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:43.254143    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:43.255586 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:43.255553    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jul 20 15:53:43.255706 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:43.255603    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 20 15:53:46.254482 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:46.254431    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jul 20 15:53:46.255006 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:46.254496    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 20 15:53:49.253847 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:49.253781    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jul 20 15:53:49.259349 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:49.259313    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:49.259725 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:49.259697    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:49.262728 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:49.262702    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:51.253410 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:51.253370    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:52.253884 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:52.253814    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jul 20 15:53:55.254512 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:55.254482    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:55.255412 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:55.255391    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:53:56.769949 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.769916    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"]
Jul 20 15:53:56.773189 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.773170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.775089 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.775064    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jul 20 15:53:56.775332 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.775314    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jul 20 15:53:56.775506 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.775486    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 20 15:53:56.775637 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.775573    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-cgwwp\""
Jul 20 15:53:56.785340 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.785313    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"]
Jul 20 15:53:56.887685 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.887652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbde63e-db1f-44e1-af07-27596b12c045-feast-data\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.887900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.887702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-online-tls\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.887900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.887726    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-registry-tls\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.887900 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.887784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jk2b\" (UniqueName: \"kubernetes.io/projected/3cbde63e-db1f-44e1-af07-27596b12c045-kube-api-access-2jk2b\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.988696 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.988660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbde63e-db1f-44e1-af07-27596b12c045-feast-data\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.988919 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.988720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-online-tls\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.988919 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.988750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-registry-tls\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.988919 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.988797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jk2b\" (UniqueName: \"kubernetes.io/projected/3cbde63e-db1f-44e1-af07-27596b12c045-kube-api-access-2jk2b\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.989166 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.989126    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbde63e-db1f-44e1-af07-27596b12c045-feast-data\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.991207 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.991183    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-registry-tls\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.991330 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.991217    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-online-tls\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:56.998669 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:56.998640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jk2b\" (UniqueName: \"kubernetes.io/projected/3cbde63e-db1f-44e1-af07-27596b12c045-kube-api-access-2jk2b\") pod \"feast-driver-ranking-765666ddf4-vnhvn\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") " pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:57.083480 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:57.083381    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:53:57.215710 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:57.215681    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"]
Jul 20 15:53:57.219024 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:53:57.218995    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbde63e_db1f_44e1_af07_27596b12c045.slice/crio-f7bd915ba2d2117a9e5a0fdbc9191ffb3795cc1b91734c2b1bc034ed6959c6ea WatchSource:0}: Error finding container f7bd915ba2d2117a9e5a0fdbc9191ffb3795cc1b91734c2b1bc034ed6959c6ea: Status 404 returned error can't find the container with id f7bd915ba2d2117a9e5a0fdbc9191ffb3795cc1b91734c2b1bc034ed6959c6ea
Jul 20 15:53:57.365097 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:57.364979    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerStarted","Data":"efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646"}
Jul 20 15:53:57.365097 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:53:57.365095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerStarted","Data":"f7bd915ba2d2117a9e5a0fdbc9191ffb3795cc1b91734c2b1bc034ed6959c6ea"}
Jul 20 15:54:02.388511 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:02.388477    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cbde63e-db1f-44e1-af07-27596b12c045" containerID="efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646" exitCode=0
Jul 20 15:54:02.388927 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:02.388551    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerDied","Data":"efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646"}
Jul 20 15:54:03.400074 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:03.400033    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerStarted","Data":"4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474"}
Jul 20 15:54:09.425312 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:09.425278    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cbde63e-db1f-44e1-af07-27596b12c045" containerID="4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474" exitCode=0
Jul 20 15:54:09.425715 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:09.425355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerDied","Data":"4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474"}
Jul 20 15:54:09.428202 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:09.428184    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 20 15:54:10.432138 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:10.432100    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerStarted","Data":"0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086"}
Jul 20 15:54:10.432602 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:10.432163    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerStarted","Data":"e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06"}
Jul 20 15:54:10.455921 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:10.455871    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podStartSLOduration=14.45585385 podStartE2EDuration="14.45585385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:54:10.45434538 +0000 UTC m=+963.569195487" watchObservedRunningTime="2026-07-20 15:54:10.45585385 +0000 UTC m=+963.570703936"
Jul 20 15:54:12.084581 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:12.084537    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:12.085094 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:12.084617    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:12.086287 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:12.086250    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jul 20 15:54:12.086287 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:12.086276    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 20 15:54:15.084636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:15.084580    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jul 20 15:54:15.085265 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:15.084661    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 20 15:54:17.084094 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:17.084055    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:17.084476 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:17.084129    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:18.083909 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:18.083866    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Jul 20 15:54:18.089538 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:18.089507    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:18.093069 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:18.093044    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:21.085116 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:21.085088    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:54:21.085944 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:54:21.085919    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:55:36.769559 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:36.769530    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"]
Jul 20 15:55:36.770073 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:36.769722    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s" podUID="7e1e4eba-8bf8-4e9f-91a7-f118d759f322" containerName="manager" containerID="cri-o://7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e" gracePeriod=10
Jul 20 15:55:37.039876 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.039825    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:55:37.115811 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.115782    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"]
Jul 20 15:55:37.116055 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.116010    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry" containerID="cri-o://e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06" gracePeriod=30
Jul 20 15:55:37.116133 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.116052    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online" containerID="cri-o://0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086" gracePeriod=30
Jul 20 15:55:37.139660 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.139631    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"]
Jul 20 15:55:37.139932 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.139903    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry" containerID="cri-o://af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850" gracePeriod=30
Jul 20 15:55:37.140050 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.139924    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online" containerID="cri-o://bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc" gracePeriod=30
Jul 20 15:55:37.147143 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.147122    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s89s8\" (UniqueName: \"kubernetes.io/projected/7e1e4eba-8bf8-4e9f-91a7-f118d759f322-kube-api-access-s89s8\") pod \"7e1e4eba-8bf8-4e9f-91a7-f118d759f322\" (UID: \"7e1e4eba-8bf8-4e9f-91a7-f118d759f322\") "
Jul 20 15:55:37.149129 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.149091    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1e4eba-8bf8-4e9f-91a7-f118d759f322-kube-api-access-s89s8" (OuterVolumeSpecName: "kube-api-access-s89s8") pod "7e1e4eba-8bf8-4e9f-91a7-f118d759f322" (UID: "7e1e4eba-8bf8-4e9f-91a7-f118d759f322"). InnerVolumeSpecName "kube-api-access-s89s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:37.248041 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.248006    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s89s8\" (UniqueName: \"kubernetes.io/projected/7e1e4eba-8bf8-4e9f-91a7-f118d759f322-kube-api-access-s89s8\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:55:37.798549 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.798516    2569 generic.go:356] "Generic (PLEG): container finished" podID="7e1e4eba-8bf8-4e9f-91a7-f118d759f322" containerID="7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e" exitCode=0
Jul 20 15:55:37.798994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.798571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s" event={"ID":"7e1e4eba-8bf8-4e9f-91a7-f118d759f322","Type":"ContainerDied","Data":"7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e"}
Jul 20 15:55:37.798994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.798576    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"
Jul 20 15:55:37.798994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.798612    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s" event={"ID":"7e1e4eba-8bf8-4e9f-91a7-f118d759f322","Type":"ContainerDied","Data":"39b1c834b2ab127f119e59e6da5e87c90ed94e1fff34bcfa6a061cd403fd4c0e"}
Jul 20 15:55:37.798994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.798634    2569 scope.go:117] "RemoveContainer" containerID="7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e"
Jul 20 15:55:37.807301 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.807282    2569 scope.go:117] "RemoveContainer" containerID="7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e"
Jul 20 15:55:37.807569 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:55:37.807547    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e\": container with ID starting with 7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e not found: ID does not exist" containerID="7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e"
Jul 20 15:55:37.807643 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.807580    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e"} err="failed to get container status \"7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e\": rpc error: code = NotFound desc = could not find container \"7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e\": container with ID starting with 7ba4d9c7129a4a720e4f1d31f386498d83b0f034d8c1d571f8166f05eb39066e not found: ID does not exist"
Jul 20 15:55:37.816325 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.816295    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"]
Jul 20 15:55:37.824770 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:37.824747    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-55d4d5564d-lkx7s"]
Jul 20 15:55:38.090695 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:38.090602    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 20 15:55:38.805127 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:38.805093    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cbde63e-db1f-44e1-af07-27596b12c045" containerID="0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086" exitCode=0
Jul 20 15:55:38.805541 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:38.805161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerDied","Data":"0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086"}
Jul 20 15:55:38.807913 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:38.807889    2569 generic.go:356] "Generic (PLEG): container finished" podID="640b04b3-190d-4b92-b22e-20d9e373034c" containerID="bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc" exitCode=0
Jul 20 15:55:38.808046 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:38.807932    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerDied","Data":"bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc"}
Jul 20 15:55:39.130147 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.130056    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-296hr"]
Jul 20 15:55:39.130292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.130241    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-296hr" podUID="9cd37187-7c99-4c38-acf3-5b5e2d9e907f" containerName="postgres" containerID="cri-o://2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158" gracePeriod=30
Jul 20 15:55:39.148272 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.148238    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xts5j"]
Jul 20 15:55:39.148431 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.148411    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j" podUID="21056a70-5dfc-4dd8-9364-05f5b6f9a010" containerName="redis" containerID="cri-o://252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8" gracePeriod=30
Jul 20 15:55:39.260033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.259991    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 20 15:55:39.409998 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.409975    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:55:39.412597 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.412578    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:55:39.444122 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.444092    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1e4eba-8bf8-4e9f-91a7-f118d759f322" path="/var/lib/kubelet/pods/7e1e4eba-8bf8-4e9f-91a7-f118d759f322/volumes"
Jul 20 15:55:39.566699 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.566666    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssj7d\" (UniqueName: \"kubernetes.io/projected/21056a70-5dfc-4dd8-9364-05f5b6f9a010-kube-api-access-ssj7d\") pod \"21056a70-5dfc-4dd8-9364-05f5b6f9a010\" (UID: \"21056a70-5dfc-4dd8-9364-05f5b6f9a010\") "
Jul 20 15:55:39.566906 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.566722    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-postgresdata\") pod \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") "
Jul 20 15:55:39.566906 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.566748    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtfdh\" (UniqueName: \"kubernetes.io/projected/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-kube-api-access-jtfdh\") pod \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\" (UID: \"9cd37187-7c99-4c38-acf3-5b5e2d9e907f\") "
Jul 20 15:55:39.568988 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.568952    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-kube-api-access-jtfdh" (OuterVolumeSpecName: "kube-api-access-jtfdh") pod "9cd37187-7c99-4c38-acf3-5b5e2d9e907f" (UID: "9cd37187-7c99-4c38-acf3-5b5e2d9e907f"). InnerVolumeSpecName "kube-api-access-jtfdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:39.569110 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.569005    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21056a70-5dfc-4dd8-9364-05f5b6f9a010-kube-api-access-ssj7d" (OuterVolumeSpecName: "kube-api-access-ssj7d") pod "21056a70-5dfc-4dd8-9364-05f5b6f9a010" (UID: "21056a70-5dfc-4dd8-9364-05f5b6f9a010"). InnerVolumeSpecName "kube-api-access-ssj7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:55:39.597158 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.597125    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "9cd37187-7c99-4c38-acf3-5b5e2d9e907f" (UID: "9cd37187-7c99-4c38-acf3-5b5e2d9e907f"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:55:39.668429 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.668345    2569 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-postgresdata\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.668429 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.668375    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtfdh\" (UniqueName: \"kubernetes.io/projected/9cd37187-7c99-4c38-acf3-5b5e2d9e907f-kube-api-access-jtfdh\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.668429 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.668389    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssj7d\" (UniqueName: \"kubernetes.io/projected/21056a70-5dfc-4dd8-9364-05f5b6f9a010-kube-api-access-ssj7d\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:55:39.813232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.813194    2569 generic.go:356] "Generic (PLEG): container finished" podID="21056a70-5dfc-4dd8-9364-05f5b6f9a010" containerID="252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8" exitCode=0
Jul 20 15:55:39.813232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.813236    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j"
Jul 20 15:55:39.813751 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.813282    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j" event={"ID":"21056a70-5dfc-4dd8-9364-05f5b6f9a010","Type":"ContainerDied","Data":"252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8"}
Jul 20 15:55:39.813751 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.813321    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-xts5j" event={"ID":"21056a70-5dfc-4dd8-9364-05f5b6f9a010","Type":"ContainerDied","Data":"5627539c80e8dbf5cdd9ed0a5139e9db8008424716a52dc687e8c7437862c2f5"}
Jul 20 15:55:39.813751 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.813337    2569 scope.go:117] "RemoveContainer" containerID="252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8"
Jul 20 15:55:39.814615 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.814597    2569 generic.go:356] "Generic (PLEG): container finished" podID="9cd37187-7c99-4c38-acf3-5b5e2d9e907f" containerID="2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158" exitCode=0
Jul 20 15:55:39.814731 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.814633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-296hr" event={"ID":"9cd37187-7c99-4c38-acf3-5b5e2d9e907f","Type":"ContainerDied","Data":"2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158"}
Jul 20 15:55:39.814731 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.814649    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-296hr"
Jul 20 15:55:39.814731 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.814672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-296hr" event={"ID":"9cd37187-7c99-4c38-acf3-5b5e2d9e907f","Type":"ContainerDied","Data":"501ae1bf39a31f4d79781ecc88cd7c430d65c5c1c5a25eb11558be21472d38d7"}
Jul 20 15:55:39.822346 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.822326    2569 scope.go:117] "RemoveContainer" containerID="252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8"
Jul 20 15:55:39.822703 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:55:39.822672    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8\": container with ID starting with 252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8 not found: ID does not exist" containerID="252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8"
Jul 20 15:55:39.822897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.822711    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8"} err="failed to get container status \"252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8\": rpc error: code = NotFound desc = could not find container \"252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8\": container with ID starting with 252f717b5df82449b72bad27d0cd98790341ba594f0916b63e55fab9d778d1f8 not found: ID does not exist"
Jul 20 15:55:39.822897 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.822735    2569 scope.go:117] "RemoveContainer" containerID="2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158"
Jul 20 15:55:39.830292 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.830274    2569 scope.go:117] "RemoveContainer" containerID="2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158"
Jul 20 15:55:39.830575 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:55:39.830558    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158\": container with ID starting with 2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158 not found: ID does not exist" containerID="2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158"
Jul 20 15:55:39.830630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.830581    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158"} err="failed to get container status \"2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158\": rpc error: code = NotFound desc = could not find container \"2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158\": container with ID starting with 2b3297a1e19e3d74b2398736841a6aad38a15825ac98b39c1b5536a90d4c0158 not found: ID does not exist"
Jul 20 15:55:39.847308 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.847278    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-296hr"]
Jul 20 15:55:39.854275 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.854245    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-296hr"]
Jul 20 15:55:39.873512 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.873479    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xts5j"]
Jul 20 15:55:39.876232 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:39.876197    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-xts5j"]
Jul 20 15:55:41.442176 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:41.442147    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21056a70-5dfc-4dd8-9364-05f5b6f9a010" path="/var/lib/kubelet/pods/21056a70-5dfc-4dd8-9364-05f5b6f9a010/volumes"
Jul 20 15:55:41.442562 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:41.442475    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cd37187-7c99-4c38-acf3-5b5e2d9e907f" path="/var/lib/kubelet/pods/9cd37187-7c99-4c38-acf3-5b5e2d9e907f/volumes"
Jul 20 15:55:48.090670 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.090621    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 20 15:55:48.583661 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.583618    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"]
Jul 20 15:55:48.583972 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.583959    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1e4eba-8bf8-4e9f-91a7-f118d759f322" containerName="manager"
Jul 20 15:55:48.584026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.583974    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1e4eba-8bf8-4e9f-91a7-f118d759f322" containerName="manager"
Jul 20 15:55:48.584026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.583998    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cd37187-7c99-4c38-acf3-5b5e2d9e907f" containerName="postgres"
Jul 20 15:55:48.584026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.584003    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cd37187-7c99-4c38-acf3-5b5e2d9e907f" containerName="postgres"
Jul 20 15:55:48.584026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.584012    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21056a70-5dfc-4dd8-9364-05f5b6f9a010" containerName="redis"
Jul 20 15:55:48.584026 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.584018    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="21056a70-5dfc-4dd8-9364-05f5b6f9a010" containerName="redis"
Jul 20 15:55:48.584464 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.584061    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="21056a70-5dfc-4dd8-9364-05f5b6f9a010" containerName="redis"
Jul 20 15:55:48.584464 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.584072    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1e4eba-8bf8-4e9f-91a7-f118d759f322" containerName="manager"
Jul 20 15:55:48.584464 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.584078    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cd37187-7c99-4c38-acf3-5b5e2d9e907f" containerName="postgres"
Jul 20 15:55:48.586994 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.586977    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:55:48.610158 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.610110    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 20 15:55:48.610346 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.610278    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-jgk78\""
Jul 20 15:55:48.610598 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.610582    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 20 15:55:48.645532 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.645500    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55f98\" (UniqueName: \"kubernetes.io/projected/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb-kube-api-access-55f98\") pod \"feast-operator-controller-manager-7495bcd-ng4lx\" (UID: \"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:55:48.733054 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.733019    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"]
Jul 20 15:55:48.746605 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.746575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55f98\" (UniqueName: \"kubernetes.io/projected/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb-kube-api-access-55f98\") pod \"feast-operator-controller-manager-7495bcd-ng4lx\" (UID: \"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:55:48.772157 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.772122    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55f98\" (UniqueName: \"kubernetes.io/projected/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb-kube-api-access-55f98\") pod \"feast-operator-controller-manager-7495bcd-ng4lx\" (UID: \"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:55:48.896626 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:48.896530    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:55:49.046477 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:49.046443    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"]
Jul 20 15:55:49.053613 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:55:49.053588    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7870f77_0fa4_4e52_b4a6_00fd5465c7cb.slice/crio-27aa9f5016b91cd72ffb18f939b2e58de68939eb6dbf48a88738e16c926ec15f WatchSource:0}: Error finding container 27aa9f5016b91cd72ffb18f939b2e58de68939eb6dbf48a88738e16c926ec15f: Status 404 returned error can't find the container with id 27aa9f5016b91cd72ffb18f939b2e58de68939eb6dbf48a88738e16c926ec15f
Jul 20 15:55:49.055802 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:49.055785    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 15:55:49.260645 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:49.260609    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 20 15:55:49.857021 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:49.856973    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" event={"ID":"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb","Type":"ContainerStarted","Data":"27aa9f5016b91cd72ffb18f939b2e58de68939eb6dbf48a88738e16c926ec15f"}
Jul 20 15:55:50.862943 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:50.862891    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" event={"ID":"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb","Type":"ContainerStarted","Data":"2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44"}
Jul 20 15:55:50.863357 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:50.863017    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:55:58.090435 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:58.090393    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 20 15:55:58.090877 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:58.090525    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:55:58.123169 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:58.118200    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" podStartSLOduration=8.509439726 podStartE2EDuration="10.118179557s" totalImagesPullingTime="1.608739831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:55:50.90050715 +0000 UTC m=+1064.015357234" watchObservedRunningTime="2026-07-20 15:55:58.118179557 +0000 UTC m=+1071.233029646"
Jul 20 15:55:59.260288 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:59.260183    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 20 15:55:59.260718 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:55:59.260370    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:56:01.869033 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:01.869006    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 15:56:07.764435 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.764410    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:56:07.788444 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.788421    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:56:07.805003 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.804963    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-online-tls\") pod \"3cbde63e-db1f-44e1-af07-27596b12c045\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") "
Jul 20 15:56:07.805193 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.805025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbde63e-db1f-44e1-af07-27596b12c045-feast-data\") pod \"3cbde63e-db1f-44e1-af07-27596b12c045\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") "
Jul 20 15:56:07.805193 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.805127    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jk2b\" (UniqueName: \"kubernetes.io/projected/3cbde63e-db1f-44e1-af07-27596b12c045-kube-api-access-2jk2b\") pod \"3cbde63e-db1f-44e1-af07-27596b12c045\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") "
Jul 20 15:56:07.805193 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.805172    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-registry-tls\") pod \"3cbde63e-db1f-44e1-af07-27596b12c045\" (UID: \"3cbde63e-db1f-44e1-af07-27596b12c045\") "
Jul 20 15:56:07.805515 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.805489    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cbde63e-db1f-44e1-af07-27596b12c045-feast-data" (OuterVolumeSpecName: "feast-data") pod "3cbde63e-db1f-44e1-af07-27596b12c045" (UID: "3cbde63e-db1f-44e1-af07-27596b12c045"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:56:07.807297 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.807261    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-online-tls" (OuterVolumeSpecName: "online-tls") pod "3cbde63e-db1f-44e1-af07-27596b12c045" (UID: "3cbde63e-db1f-44e1-af07-27596b12c045"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:56:07.807399 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.807308    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cbde63e-db1f-44e1-af07-27596b12c045-kube-api-access-2jk2b" (OuterVolumeSpecName: "kube-api-access-2jk2b") pod "3cbde63e-db1f-44e1-af07-27596b12c045" (UID: "3cbde63e-db1f-44e1-af07-27596b12c045"). InnerVolumeSpecName "kube-api-access-2jk2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:56:07.807504 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.807486    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3cbde63e-db1f-44e1-af07-27596b12c045" (UID: "3cbde63e-db1f-44e1-af07-27596b12c045"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:56:07.906573 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906536    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz5zv\" (UniqueName: \"kubernetes.io/projected/640b04b3-190d-4b92-b22e-20d9e373034c-kube-api-access-hz5zv\") pod \"640b04b3-190d-4b92-b22e-20d9e373034c\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") "
Jul 20 15:56:07.906795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906651    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-registry-tls\") pod \"640b04b3-190d-4b92-b22e-20d9e373034c\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") "
Jul 20 15:56:07.906795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906683    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-online-tls\") pod \"640b04b3-190d-4b92-b22e-20d9e373034c\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") "
Jul 20 15:56:07.906795 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906711    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/640b04b3-190d-4b92-b22e-20d9e373034c-feast-data\") pod \"640b04b3-190d-4b92-b22e-20d9e373034c\" (UID: \"640b04b3-190d-4b92-b22e-20d9e373034c\") "
Jul 20 15:56:07.906990 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906944    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jk2b\" (UniqueName: \"kubernetes.io/projected/3cbde63e-db1f-44e1-af07-27596b12c045-kube-api-access-2jk2b\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:07.906990 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906963    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:07.906990 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906977    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3cbde63e-db1f-44e1-af07-27596b12c045-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:07.906990 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.906989    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3cbde63e-db1f-44e1-af07-27596b12c045-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:07.908679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.908642    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640b04b3-190d-4b92-b22e-20d9e373034c-kube-api-access-hz5zv" (OuterVolumeSpecName: "kube-api-access-hz5zv") pod "640b04b3-190d-4b92-b22e-20d9e373034c" (UID: "640b04b3-190d-4b92-b22e-20d9e373034c"). InnerVolumeSpecName "kube-api-access-hz5zv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:56:07.908679 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.908665    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "640b04b3-190d-4b92-b22e-20d9e373034c" (UID: "640b04b3-190d-4b92-b22e-20d9e373034c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:56:07.908858 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.908703    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-online-tls" (OuterVolumeSpecName: "online-tls") pod "640b04b3-190d-4b92-b22e-20d9e373034c" (UID: "640b04b3-190d-4b92-b22e-20d9e373034c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:56:07.915986 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.915963    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/640b04b3-190d-4b92-b22e-20d9e373034c-feast-data" (OuterVolumeSpecName: "feast-data") pod "640b04b3-190d-4b92-b22e-20d9e373034c" (UID: "640b04b3-190d-4b92-b22e-20d9e373034c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:56:07.929735 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.929705    2569 generic.go:356] "Generic (PLEG): container finished" podID="3cbde63e-db1f-44e1-af07-27596b12c045" containerID="e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06" exitCode=137
Jul 20 15:56:07.929876 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.929764    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"
Jul 20 15:56:07.929876 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.929788    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerDied","Data":"e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06"}
Jul 20 15:56:07.929876 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.929868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn" event={"ID":"3cbde63e-db1f-44e1-af07-27596b12c045","Type":"ContainerDied","Data":"f7bd915ba2d2117a9e5a0fdbc9191ffb3795cc1b91734c2b1bc034ed6959c6ea"}
Jul 20 15:56:07.930017 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.929894    2569 scope.go:117] "RemoveContainer" containerID="0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086"
Jul 20 15:56:07.932328 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.932300    2569 generic.go:356] "Generic (PLEG): container finished" podID="640b04b3-190d-4b92-b22e-20d9e373034c" containerID="af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850" exitCode=137
Jul 20 15:56:07.932437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.932342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerDied","Data":"af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850"}
Jul 20 15:56:07.932437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.932379    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv" event={"ID":"640b04b3-190d-4b92-b22e-20d9e373034c","Type":"ContainerDied","Data":"03cf12e7697dcf7e361218b4075f8225dd6e8b05c746e6b365a425ea20573273"}
Jul 20 15:56:07.932437 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.932406    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"
Jul 20 15:56:07.938789 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.938708    2569 scope.go:117] "RemoveContainer" containerID="e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06"
Jul 20 15:56:07.946211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.946196    2569 scope.go:117] "RemoveContainer" containerID="4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474"
Jul 20 15:56:07.953356 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.953337    2569 scope.go:117] "RemoveContainer" containerID="efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646"
Jul 20 15:56:07.960689 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.960670    2569 scope.go:117] "RemoveContainer" containerID="0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086"
Jul 20 15:56:07.960978 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.960959    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086\": container with ID starting with 0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086 not found: ID does not exist" containerID="0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086"
Jul 20 15:56:07.961047 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.960986    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086"} err="failed to get container status \"0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086\": rpc error: code = NotFound desc = could not find container \"0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086\": container with ID starting with 0503b7cef01b830bdca9872395b3772b34519eae1b5d0ef6ee90a7a7fa88e086 not found: ID does not exist"
Jul 20 15:56:07.961047 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961002    2569 scope.go:117] "RemoveContainer" containerID="e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06"
Jul 20 15:56:07.961203 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.961188    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06\": container with ID starting with e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06 not found: ID does not exist" containerID="e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06"
Jul 20 15:56:07.961242 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961208    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06"} err="failed to get container status \"e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06\": rpc error: code = NotFound desc = could not find container \"e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06\": container with ID starting with e4f10d9873a231f131c225f860c065ddd763c00507cce357db0380dfaafb6a06 not found: ID does not exist"
Jul 20 15:56:07.961242 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961220    2569 scope.go:117] "RemoveContainer" containerID="4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474"
Jul 20 15:56:07.961400 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.961385    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474\": container with ID starting with 4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474 not found: ID does not exist" containerID="4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474"
Jul 20 15:56:07.961441 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961405    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474"} err="failed to get container status \"4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474\": rpc error: code = NotFound desc = could not find container \"4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474\": container with ID starting with 4a80e0731445b66c43e65805632322266d50d0638ef39e337a3597abe0d5d474 not found: ID does not exist"
Jul 20 15:56:07.961441 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961433    2569 scope.go:117] "RemoveContainer" containerID="efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646"
Jul 20 15:56:07.961684 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.961657    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646\": container with ID starting with efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646 not found: ID does not exist" containerID="efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646"
Jul 20 15:56:07.961730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961680    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646"} err="failed to get container status \"efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646\": rpc error: code = NotFound desc = could not find container \"efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646\": container with ID starting with efaf729d1b7b7b2bff76c11db35a1fdf12843217cd1a1e97060443d8acc9e646 not found: ID does not exist"
Jul 20 15:56:07.961730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.961693    2569 scope.go:117] "RemoveContainer" containerID="bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc"
Jul 20 15:56:07.968028 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.968006    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"]
Jul 20 15:56:07.969334 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.969314    2569 scope.go:117] "RemoveContainer" containerID="af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850"
Jul 20 15:56:07.977188 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.977170    2569 scope.go:117] "RemoveContainer" containerID="03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4"
Jul 20 15:56:07.980703 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.980679    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-765666ddf4-vnhvn"]
Jul 20 15:56:07.984970 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.984951    2569 scope.go:117] "RemoveContainer" containerID="ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6"
Jul 20 15:56:07.992123 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992101    2569 scope.go:117] "RemoveContainer" containerID="bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc"
Jul 20 15:56:07.992389 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.992369    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc\": container with ID starting with bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc not found: ID does not exist" containerID="bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc"
Jul 20 15:56:07.992467 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992393    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc"} err="failed to get container status \"bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc\": rpc error: code = NotFound desc = could not find container \"bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc\": container with ID starting with bb8b41b0f461e2ac2e710e71c65e24044ed82432d1bca95ea516917a80f4d4cc not found: ID does not exist"
Jul 20 15:56:07.992467 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992413    2569 scope.go:117] "RemoveContainer" containerID="af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850"
Jul 20 15:56:07.992657 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.992640    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850\": container with ID starting with af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850 not found: ID does not exist" containerID="af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850"
Jul 20 15:56:07.992698 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992671    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850"} err="failed to get container status \"af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850\": rpc error: code = NotFound desc = could not find container \"af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850\": container with ID starting with af07037e9808d2e82abeae4bc3d265cc0385174c45d03e8e209dab99ceb08850 not found: ID does not exist"
Jul 20 15:56:07.992698 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992686    2569 scope.go:117] "RemoveContainer" containerID="03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4"
Jul 20 15:56:07.992917 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.992901    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4\": container with ID starting with 03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4 not found: ID does not exist" containerID="03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4"
Jul 20 15:56:07.992961 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992921    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4"} err="failed to get container status \"03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4\": rpc error: code = NotFound desc = could not find container \"03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4\": container with ID starting with 03af58a715a2c9a061413901a92560bf3a73697c8f6763073cae3ac025e00bb4 not found: ID does not exist"
Jul 20 15:56:07.992961 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.992932    2569 scope.go:117] "RemoveContainer" containerID="ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6"
Jul 20 15:56:07.993114 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:07.993099    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6\": container with ID starting with ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6 not found: ID does not exist" containerID="ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6"
Jul 20 15:56:07.993154 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:07.993118    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6"} err="failed to get container status \"ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6\": rpc error: code = NotFound desc = could not find container \"ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6\": container with ID starting with ffe656419b66b28757b920ba05de50e6823dfa5d87d0722763538c79fe6651b6 not found: ID does not exist"
Jul 20 15:56:08.001300 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:08.001279    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"]
Jul 20 15:56:08.005364 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:08.005343    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-75ff6549c-vjtgv"]
Jul 20 15:56:08.008340 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:08.008324    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:08.008396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:08.008342    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/640b04b3-190d-4b92-b22e-20d9e373034c-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:08.008396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:08.008351    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/640b04b3-190d-4b92-b22e-20d9e373034c-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:08.008396 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:08.008360    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz5zv\" (UniqueName: \"kubernetes.io/projected/640b04b3-190d-4b92-b22e-20d9e373034c-kube-api-access-hz5zv\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:56:09.442622 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:09.442592    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" path="/var/lib/kubelet/pods/3cbde63e-db1f-44e1-af07-27596b12c045/volumes"
Jul 20 15:56:09.443101 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:09.443088    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" path="/var/lib/kubelet/pods/640b04b3-190d-4b92-b22e-20d9e373034c/volumes"
Jul 20 15:56:13.806419 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806381    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"]
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806769    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="feast-init"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806787    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="feast-init"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806803    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806810    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806826    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="feast-init"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806851    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="feast-init"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806861    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="feast-apply"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806869    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="feast-apply"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806879    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806888    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806901    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806908    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806919    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="feast-apply"
Jul 20 15:56:13.806920 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806926    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="feast-apply"
Jul 20 15:56:13.807636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806942    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online"
Jul 20 15:56:13.807636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.806949    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online"
Jul 20 15:56:13.807636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.807025    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="registry"
Jul 20 15:56:13.807636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.807040    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="registry"
Jul 20 15:56:13.807636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.807049    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="640b04b3-190d-4b92-b22e-20d9e373034c" containerName="online"
Jul 20 15:56:13.807636 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.807059    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cbde63e-db1f-44e1-af07-27596b12c045" containerName="online"
Jul 20 15:56:13.812663 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.812641    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:13.814851 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.814807    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 15:56:13.814975 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.814890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-w5xfm\""
Jul 20 15:56:13.815100 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.815082    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 15:56:13.815302 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.815097    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 20 15:56:13.815416 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.815100    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 20 15:56:13.815416 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.815190    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 20 15:56:13.815545 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.815533    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 20 15:56:13.823009 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.822985    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"]
Jul 20 15:56:13.955642 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.955612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:13.955642 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.955646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:13.955885 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.955686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:13.955885 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.955739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldv8f\" (UniqueName: \"kubernetes.io/projected/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-kube-api-access-ldv8f\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:13.955885 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.955766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:13.955885 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:13.955792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057145 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057145 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057110    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldv8f\" (UniqueName: \"kubernetes.io/projected/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-kube-api-access-ldv8f\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057145 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057436 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057436 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057201    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057436 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:14.057215    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 20 15:56:14.057436 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.057436 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:56:14.057307    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls podName:753f5c30-7e26-45ab-9ddb-f30b6ecd952b nodeName:}" failed. No retries permitted until 2026-07-20 15:56:14.557283503 +0000 UTC m=+1087.672133574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls") pod "feast-simple-feast-setup-777d6cc998-rlm26" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b") : secret "feast-simple-feast-setup-online-tls" not found
Jul 20 15:56:14.057750 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.057724    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.059826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.059801    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.059826 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.059814    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.059985 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.059858    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.066791 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.066768    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldv8f\" (UniqueName: \"kubernetes.io/projected/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-kube-api-access-ldv8f\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.561218 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.561169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.563767 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.563738    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-rlm26\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.730939 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.730900    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:14.865690 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.865606    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"]
Jul 20 15:56:14.868495 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:56:14.868469    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod753f5c30_7e26_45ab_9ddb_f30b6ecd952b.slice/crio-9c16858fcb607cd3fbdcfd23997d02feffc6e9ff1c46d01047367a1753c69054 WatchSource:0}: Error finding container 9c16858fcb607cd3fbdcfd23997d02feffc6e9ff1c46d01047367a1753c69054: Status 404 returned error can't find the container with id 9c16858fcb607cd3fbdcfd23997d02feffc6e9ff1c46d01047367a1753c69054
Jul 20 15:56:14.966289 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:14.966254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"9c16858fcb607cd3fbdcfd23997d02feffc6e9ff1c46d01047367a1753c69054"}
Jul 20 15:56:28.029845 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:28.029808    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"070aee0135ada08fce8737b92bea698a6463f0312e47757c6aafc6d6fee71bac"}
Jul 20 15:56:33.051665 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:33.051630    2569 generic.go:356] "Generic (PLEG): container finished" podID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerID="070aee0135ada08fce8737b92bea698a6463f0312e47757c6aafc6d6fee71bac" exitCode=0
Jul 20 15:56:33.052144 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:33.051682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"070aee0135ada08fce8737b92bea698a6463f0312e47757c6aafc6d6fee71bac"}
Jul 20 15:56:34.058124 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:34.058081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"ae52901fa416ebfc5b50c048709cab961c5e13fce03be8c78cbbb8393e1ee9a9"}
Jul 20 15:56:39.079895 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:39.079863    2569 generic.go:356] "Generic (PLEG): container finished" podID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerID="ae52901fa416ebfc5b50c048709cab961c5e13fce03be8c78cbbb8393e1ee9a9" exitCode=0
Jul 20 15:56:39.080296 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:39.079941    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"ae52901fa416ebfc5b50c048709cab961c5e13fce03be8c78cbbb8393e1ee9a9"}
Jul 20 15:56:40.090295 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:40.090248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"70ab15803c7275845670c528d0240e10a2b6ac56d10aea581ef117be089262b3"}
Jul 20 15:56:40.090777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:40.090316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"a04b76352ff428b88d39bbdf59909461e6855af788f600d9e66490af372d7305"}
Jul 20 15:56:40.090777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:40.090342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"856dbcc7b6994a1051a517183af4a336df45cb9a0a99d0caf97974441b616789"}
Jul 20 15:56:40.090777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:40.090361    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerStarted","Data":"2ddc4f1cfd74559f83d12ef162426a81106843411166fbe070c3c131ef5a3b55"}
Jul 20 15:56:40.127650 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:40.127546    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podStartSLOduration=14.744622466 podStartE2EDuration="27.127522818s" totalImagesPullingTime="12.382900352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:56:40.12263702 +0000 UTC m=+1113.237487105" watchObservedRunningTime="2026-07-20 15:56:40.127522818 +0000 UTC m=+1113.242372904"
Jul 20 15:56:41.731529 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.731475    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:41.732036 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.731541    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:41.732036 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.731562    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:41.732036 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.731580    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:41.733362 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.733331    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jul 20 15:56:41.733593 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.733358    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 20 15:56:41.733683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.733410    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
Jul 20 15:56:41.733753 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:41.733425    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 20 15:56:44.731990 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.731933    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:44.732511 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732156    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jul 20 15:56:44.732511 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732202    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:44.732511 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732297    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 20 15:56:44.732511 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732380    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
Jul 20 15:56:44.732511 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732169    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 20 15:56:44.732798 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732781    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:44.732881 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:44.732817    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.732813 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.732783    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.733289 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.732905    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.733289 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.733195    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.734063 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.734038    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.734170 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.734111    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.734170 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.734159    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:47.737867 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:47.737844    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:56:48.135759 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:56:48.135718    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:57:50.265615 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.265530    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"]
Jul 20 15:57:50.266179 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.265856    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="registry" containerID="cri-o://2ddc4f1cfd74559f83d12ef162426a81106843411166fbe070c3c131ef5a3b55" gracePeriod=30
Jul 20 15:57:50.266179 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.265892    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="offline" containerID="cri-o://a04b76352ff428b88d39bbdf59909461e6855af788f600d9e66490af372d7305" gracePeriod=30
Jul 20 15:57:50.266179 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.265904    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online" containerID="cri-o://856dbcc7b6994a1051a517183af4a336df45cb9a0a99d0caf97974441b616789" gracePeriod=30
Jul 20 15:57:50.266179 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.265904    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui" containerID="cri-o://70ab15803c7275845670c528d0240e10a2b6ac56d10aea581ef117be089262b3" gracePeriod=30
Jul 20 15:57:50.631140 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.631045    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"]
Jul 20 15:57:50.634757 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.634727    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.637567 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.637545    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5vwl4\""
Jul 20 15:57:50.651918 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.651803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpj66\" (UniqueName: \"kubernetes.io/projected/0a41b3da-ac38-4de0-b652-d910899cbaf2-kube-api-access-bpj66\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.651918 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.651862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.651918 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.651887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a41b3da-ac38-4de0-b652-d910899cbaf2-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.652280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.651950    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.652280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.651982    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.652280 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.652005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.655793 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.655767    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"]
Jul 20 15:57:50.753608 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.753555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpj66\" (UniqueName: \"kubernetes.io/projected/0a41b3da-ac38-4de0-b652-d910899cbaf2-kube-api-access-bpj66\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.754076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.754014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.754076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.754077    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a41b3da-ac38-4de0-b652-d910899cbaf2-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.754319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.754177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.754319 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.754227    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.754422 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:57:50.754344    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 20 15:57:50.754422 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:57:50.754403    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls podName:0a41b3da-ac38-4de0-b652-d910899cbaf2 nodeName:}" failed. No retries permitted until 2026-07-20 15:57:51.254383143 +0000 UTC m=+1184.369233221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls") pod "feast-simple-feast-setup-777d6cc998-htpnf" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2") : secret "feast-simple-feast-setup-online-tls" not found
Jul 20 15:57:50.754721 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.754693    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a41b3da-ac38-4de0-b652-d910899cbaf2-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.755175 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.755031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.755175 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:57:50.755072    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:57:50.755175 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:57:50.755149    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls podName:0a41b3da-ac38-4de0-b652-d910899cbaf2 nodeName:}" failed. No retries permitted until 2026-07-20 15:57:51.255130733 +0000 UTC m=+1184.369980798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls") pod "feast-simple-feast-setup-777d6cc998-htpnf" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 15:57:50.757425 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.757394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.757877 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.757855    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:50.766009 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:50.765974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpj66\" (UniqueName: \"kubernetes.io/projected/0a41b3da-ac38-4de0-b652-d910899cbaf2-kube-api-access-bpj66\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:51.259197 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.259167    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:51.259366 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.259254    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:51.261562 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.261531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:51.261684 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.261583    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-htpnf\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:51.365557 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.365523    2569 generic.go:356] "Generic (PLEG): container finished" podID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerID="70ab15803c7275845670c528d0240e10a2b6ac56d10aea581ef117be089262b3" exitCode=0
Jul 20 15:57:51.365557 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.365547    2569 generic.go:356] "Generic (PLEG): container finished" podID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerID="856dbcc7b6994a1051a517183af4a336df45cb9a0a99d0caf97974441b616789" exitCode=0
Jul 20 15:57:51.365995 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.365573    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"70ab15803c7275845670c528d0240e10a2b6ac56d10aea581ef117be089262b3"}
Jul 20 15:57:51.365995 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.365603    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"856dbcc7b6994a1051a517183af4a336df45cb9a0a99d0caf97974441b616789"}
Jul 20 15:57:51.547188 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.547094    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:57:51.699081 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:51.699057    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"]
Jul 20 15:57:51.700321 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:57:51.700288    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a41b3da_ac38_4de0_b652_d910899cbaf2.slice/crio-9af05f935e50da099bcbd7a631b6c7af7e62e0be366c79e9a7ea3cb1bea2f70b WatchSource:0}: Error finding container 9af05f935e50da099bcbd7a631b6c7af7e62e0be366c79e9a7ea3cb1bea2f70b: Status 404 returned error can't find the container with id 9af05f935e50da099bcbd7a631b6c7af7e62e0be366c79e9a7ea3cb1bea2f70b
Jul 20 15:57:52.371216 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:52.371170    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"fa08b54e21939816d032a20de2a908f87a993acc371d2fb3dd40d2a30bd8b8b2"}
Jul 20 15:57:52.371718 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:52.371229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"9af05f935e50da099bcbd7a631b6c7af7e62e0be366c79e9a7ea3cb1bea2f70b"}
Jul 20 15:57:57.390352 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:57.390313    2569 generic.go:356] "Generic (PLEG): container finished" podID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerID="fa08b54e21939816d032a20de2a908f87a993acc371d2fb3dd40d2a30bd8b8b2" exitCode=0
Jul 20 15:57:57.390812 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:57.390387    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"fa08b54e21939816d032a20de2a908f87a993acc371d2fb3dd40d2a30bd8b8b2"}
Jul 20 15:57:57.734629 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:57.734521    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 20 15:57:58.133240 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:58.133192    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 20 15:57:58.396667 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:57:58.396580    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"9056f386d3725009db029f29a81804ecc3290f1cef09cb956fa48e20fd3d2da9"}
Jul 20 15:58:03.417796 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:03.417706    2569 generic.go:356] "Generic (PLEG): container finished" podID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerID="9056f386d3725009db029f29a81804ecc3290f1cef09cb956fa48e20fd3d2da9" exitCode=0
Jul 20 15:58:03.417796 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:03.417782    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"9056f386d3725009db029f29a81804ecc3290f1cef09cb956fa48e20fd3d2da9"}
Jul 20 15:58:04.427366 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:04.427327    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"bb3c41215771077622169aa6791d8dad5b17515be4d1af7ebea6ef44e1b677ba"}
Jul 20 15:58:04.427926 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:04.427389    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"3b0b86243e964167ce7186867f831718df42aa7cbcb9dd912177c65911210c40"}
Jul 20 15:58:04.427926 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:04.427409    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"d286bd65bd00783b4f5e9ec736e6938152448dc7b826c440e6d13a4be286f7c1"}
Jul 20 15:58:04.427926 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:04.427429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerStarted","Data":"b27c941df63927265d7e6f5b0d443fcebddd8eefd9ba65787c18089b494c9dfc"}
Jul 20 15:58:04.457682 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:04.457615    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podStartSLOduration=14.457590409 podStartE2EDuration="14.457590409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:58:04.454970488 +0000 UTC m=+1197.569820604" watchObservedRunningTime="2026-07-20 15:58:04.457590409 +0000 UTC m=+1197.572440497"
Jul 20 15:58:06.548231 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.548182    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:06.548740 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.548251    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:06.548740 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.548273    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:06.548740 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.548290    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:06.550315 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.550279    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
Jul 20 15:58:06.550459 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.550367    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 20 15:58:06.550526 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.550471    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Jul 20 15:58:06.550669 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:06.550630    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 20 15:58:07.733799 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:07.733739    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 20 15:58:08.132630 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:08.132583    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 20 15:58:09.547758 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:09.547708    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 20 15:58:09.548340 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:09.548313    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:09.548656 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:09.548636    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:09.548812 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:09.548787    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:09.549135 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:09.549118    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:09.553632 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:09.553616    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:10.466344 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:10.466312    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:10.466526 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:10.466364    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:10.469722 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:10.469698    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:11.471213 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:11.471183    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:11.547553 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:11.547524    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:12.548751 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:12.548718    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:13.477952 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:13.477927    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 15:58:17.734185 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:17.734130    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 20 15:58:17.734662 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:17.734281    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:58:18.132936 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:18.132888    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 20 15:58:18.133125 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:18.133014    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:58:20.506005 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:20.505972    2569 generic.go:356] "Generic (PLEG): container finished" podID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerID="a04b76352ff428b88d39bbdf59909461e6855af788f600d9e66490af372d7305" exitCode=137
Jul 20 15:58:20.506005 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:20.505997    2569 generic.go:356] "Generic (PLEG): container finished" podID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerID="2ddc4f1cfd74559f83d12ef162426a81106843411166fbe070c3c131ef5a3b55" exitCode=137
Jul 20 15:58:20.506415 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:20.506048    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"a04b76352ff428b88d39bbdf59909461e6855af788f600d9e66490af372d7305"}
Jul 20 15:58:20.506415 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:20.506092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"2ddc4f1cfd74559f83d12ef162426a81106843411166fbe070c3c131ef5a3b55"}
Jul 20 15:58:20.913400 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:20.913367    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:58:21.030681 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.030647    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls\") pod \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") "
Jul 20 15:58:21.030873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.030691    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-offline-tls\") pod \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") "
Jul 20 15:58:21.030873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.030706    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-ui-tls\") pod \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") "
Jul 20 15:58:21.030873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.030749    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-feast-data\") pod \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") "
Jul 20 15:58:21.030873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.030778    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-registry-tls\") pod \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") "
Jul 20 15:58:21.030873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.030822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldv8f\" (UniqueName: \"kubernetes.io/projected/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-kube-api-access-ldv8f\") pod \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\" (UID: \"753f5c30-7e26-45ab-9ddb-f30b6ecd952b\") "
Jul 20 15:58:21.031453 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.031383    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-feast-data" (OuterVolumeSpecName: "feast-data") pod "753f5c30-7e26-45ab-9ddb-f30b6ecd952b" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 15:58:21.033185 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.033152    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls" (OuterVolumeSpecName: "online-tls") pod "753f5c30-7e26-45ab-9ddb-f30b6ecd952b" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:21.033303 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.033206    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-kube-api-access-ldv8f" (OuterVolumeSpecName: "kube-api-access-ldv8f") pod "753f5c30-7e26-45ab-9ddb-f30b6ecd952b" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b"). InnerVolumeSpecName "kube-api-access-ldv8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 15:58:21.033303 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.033242    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "753f5c30-7e26-45ab-9ddb-f30b6ecd952b" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:21.033303 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.033292    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "753f5c30-7e26-45ab-9ddb-f30b6ecd952b" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:21.033430 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.033313    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "753f5c30-7e26-45ab-9ddb-f30b6ecd952b" (UID: "753f5c30-7e26-45ab-9ddb-f30b6ecd952b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 15:58:21.131857 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.131804    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldv8f\" (UniqueName: \"kubernetes.io/projected/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-kube-api-access-ldv8f\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:58:21.131857 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.131860    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:58:21.132059 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.131874    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:58:21.132059 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.131882    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:58:21.132059 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.131890    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:58:21.132059 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.131898    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/753f5c30-7e26-45ab-9ddb-f30b6ecd952b-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 15:58:21.513198 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.513158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26" event={"ID":"753f5c30-7e26-45ab-9ddb-f30b6ecd952b","Type":"ContainerDied","Data":"9c16858fcb607cd3fbdcfd23997d02feffc6e9ff1c46d01047367a1753c69054"}
Jul 20 15:58:21.513198 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.513193    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"
Jul 20 15:58:21.513707 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.513222    2569 scope.go:117] "RemoveContainer" containerID="70ab15803c7275845670c528d0240e10a2b6ac56d10aea581ef117be089262b3"
Jul 20 15:58:21.521945 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.521925    2569 scope.go:117] "RemoveContainer" containerID="a04b76352ff428b88d39bbdf59909461e6855af788f600d9e66490af372d7305"
Jul 20 15:58:21.529513 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.529495    2569 scope.go:117] "RemoveContainer" containerID="856dbcc7b6994a1051a517183af4a336df45cb9a0a99d0caf97974441b616789"
Jul 20 15:58:21.532225 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.532205    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"]
Jul 20 15:58:21.537777 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.537643    2569 scope.go:117] "RemoveContainer" containerID="2ddc4f1cfd74559f83d12ef162426a81106843411166fbe070c3c131ef5a3b55"
Jul 20 15:58:21.538626 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.538538    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-rlm26"]
Jul 20 15:58:21.545093 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.545071    2569 scope.go:117] "RemoveContainer" containerID="ae52901fa416ebfc5b50c048709cab961c5e13fce03be8c78cbbb8393e1ee9a9"
Jul 20 15:58:21.552040 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:21.552011    2569 scope.go:117] "RemoveContainer" containerID="070aee0135ada08fce8737b92bea698a6463f0312e47757c6aafc6d6fee71bac"
Jul 20 15:58:23.443076 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:58:23.443043    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" path="/var/lib/kubelet/pods/753f5c30-7e26-45ab-9ddb-f30b6ecd952b/volumes"
Jul 20 15:59:16.326785 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.326742    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"]
Jul 20 15:59:16.327211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327158    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui"
Jul 20 15:59:16.327211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327172    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui"
Jul 20 15:59:16.327211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327188    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="registry"
Jul 20 15:59:16.327211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327196    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="registry"
Jul 20 15:59:16.327211 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327210    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327220    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327231    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="feast-init"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327239    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="feast-init"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327250    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="offline"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327258    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="offline"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327270    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="feast-apply"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327278    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="feast-apply"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327337    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="registry"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327346    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="offline"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327358    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="online"
Jul 20 15:59:16.327380 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.327367    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="753f5c30-7e26-45ab-9ddb-f30b6ecd952b" containerName="ui"
Jul 20 15:59:16.332088 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.332070    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.334489 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334454    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 20 15:59:16.334489 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334482    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 20 15:59:16.334719 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334567    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 20 15:59:16.334719 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334454    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 20 15:59:16.334873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334722    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 20 15:59:16.334873 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334802    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-hjjgn\""
Jul 20 15:59:16.335015 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.334938    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 20 15:59:16.341364 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.341337    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"]
Jul 20 15:59:16.480343 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.480309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.480343 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.480353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.480604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.480389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ebd17247-b726-4c7e-b858-ef9f165b00bf-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.480604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.480417    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd17247-b726-4c7e-b858-ef9f165b00bf-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.480604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.480441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65glp\" (UniqueName: \"kubernetes.io/projected/ebd17247-b726-4c7e-b858-ef9f165b00bf-kube-api-access-65glp\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.480604 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.480501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582098 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582098 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582098 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ebd17247-b726-4c7e-b858-ef9f165b00bf-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582105    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd17247-b726-4c7e-b858-ef9f165b00bf-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65glp\" (UniqueName: \"kubernetes.io/projected/ebd17247-b726-4c7e-b858-ef9f165b00bf-kube-api-access-65glp\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582371 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582177    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582635 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:59:16.582610    2569 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 20 15:59:16.582729 ip-10-0-141-8 kubenswrapper[2569]: E0720 15:59:16.582697    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls podName:ebd17247-b726-4c7e-b858-ef9f165b00bf nodeName:}" failed. No retries permitted until 2026-07-20 15:59:17.082674685 +0000 UTC m=+1270.197524764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-pf2dj" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 20 15:59:16.582793 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd17247-b726-4c7e-b858-ef9f165b00bf-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.582966 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.582930    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ebd17247-b726-4c7e-b858-ef9f165b00bf-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.584680 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.584657    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.584950 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.584932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:16.591594 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:16.591568    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65glp\" (UniqueName: \"kubernetes.io/projected/ebd17247-b726-4c7e-b858-ef9f165b00bf-kube-api-access-65glp\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:17.087417 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:17.087374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:17.089683 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:17.089658    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-pf2dj\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:17.243154 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:17.243113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:17.382918 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:17.382813    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"]
Jul 20 15:59:17.386137 ip-10-0-141-8 kubenswrapper[2569]: W0720 15:59:17.386110    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebd17247_b726_4c7e_b858_ef9f165b00bf.slice/crio-a718d6c924f370bc3945f391cc2822297fd2645efaf99ea89525cdcb6b094393 WatchSource:0}: Error finding container a718d6c924f370bc3945f391cc2822297fd2645efaf99ea89525cdcb6b094393: Status 404 returned error can't find the container with id a718d6c924f370bc3945f391cc2822297fd2645efaf99ea89525cdcb6b094393
Jul 20 15:59:17.732249 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:17.732147    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerStarted","Data":"d8c4509f2bf79da56d9403c3ef6aabda6ec939eccfc25cc4062242852cc28f58"}
Jul 20 15:59:17.732249 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:17.732203    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerStarted","Data":"a718d6c924f370bc3945f391cc2822297fd2645efaf99ea89525cdcb6b094393"}
Jul 20 15:59:22.751730 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:22.751698    2569 generic.go:356] "Generic (PLEG): container finished" podID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerID="d8c4509f2bf79da56d9403c3ef6aabda6ec939eccfc25cc4062242852cc28f58" exitCode=0
Jul 20 15:59:22.752104 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:22.751771    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerDied","Data":"d8c4509f2bf79da56d9403c3ef6aabda6ec939eccfc25cc4062242852cc28f58"}
Jul 20 15:59:23.757887 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:23.757853    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerStarted","Data":"4fed127064baf1c02031014870bd5bcdadd363dc7a0dc8328754ce4f17b77319"}
Jul 20 15:59:29.782573 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:29.782535    2569 generic.go:356] "Generic (PLEG): container finished" podID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerID="4fed127064baf1c02031014870bd5bcdadd363dc7a0dc8328754ce4f17b77319" exitCode=0
Jul 20 15:59:29.783050 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:29.782611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerDied","Data":"4fed127064baf1c02031014870bd5bcdadd363dc7a0dc8328754ce4f17b77319"}
Jul 20 15:59:30.791409 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:30.791363    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerStarted","Data":"e46e02a200e256f6ee85d7f4b595ead91e00e77c29cea2d8f7f2c014b47a1298"}
Jul 20 15:59:30.791957 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:30.791427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerStarted","Data":"76d19b633ab668c4083a5c880f366d7c53f46cfce5e282e96bb69ba55cdcc0c4"}
Jul 20 15:59:30.791957 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:30.791447    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerStarted","Data":"288db4a2def7c48b661228899c2d2b6c6eb257b30ceea189f9deda43d9a1ae82"}
Jul 20 15:59:30.819414 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:30.819338    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podStartSLOduration=14.819315928 podStartE2EDuration="14.819315928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 15:59:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 15:59:30.816914816 +0000 UTC m=+1283.931764904" watchObservedRunningTime="2026-07-20 15:59:30.819315928 +0000 UTC m=+1283.934166014"
Jul 20 15:59:32.243348 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:32.243300    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:32.243828 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:32.243366    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:32.243828 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:32.243384    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:32.245000 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:32.244962    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jul 20 15:59:32.245244 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:32.244986    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.37:8816: connect: connection refused"
Jul 20 15:59:32.245347 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:32.245004    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jul 20 15:59:35.244381 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:35.244337    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jul 20 15:59:35.244381 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:35.244361    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jul 20 15:59:35.244949 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:35.244348    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.37:8816: connect: connection refused"
Jul 20 15:59:37.243635 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:37.243592    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:37.244077 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:37.243654    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:37.244077 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:37.243667    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:38.244865 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:38.244814    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:38.245299 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:38.245075    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:38.245817 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:38.245795    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:38.245982 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:38.245903    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:38.251187 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:38.251163    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 15:59:38.833072 ip-10-0-141-8 kubenswrapper[2569]: I0720 15:59:38.833041    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 16:00:41.670574 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.670488    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"]
Jul 20 16:00:41.671094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.670744    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online" containerID="cri-o://288db4a2def7c48b661228899c2d2b6c6eb257b30ceea189f9deda43d9a1ae82" gracePeriod=30
Jul 20 16:00:41.671094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.670818    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="offline" containerID="cri-o://76d19b633ab668c4083a5c880f366d7c53f46cfce5e282e96bb69ba55cdcc0c4" gracePeriod=30
Jul 20 16:00:41.671094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.670802    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui" containerID="cri-o://e46e02a200e256f6ee85d7f4b595ead91e00e77c29cea2d8f7f2c014b47a1298" gracePeriod=30
Jul 20 16:00:41.852129 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.852083    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"]
Jul 20 16:00:41.852417 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.852380    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui" containerID="cri-o://bb3c41215771077622169aa6791d8dad5b17515be4d1af7ebea6ef44e1b677ba" gracePeriod=30
Jul 20 16:00:41.852541 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.852419    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="offline" containerID="cri-o://3b0b86243e964167ce7186867f831718df42aa7cbcb9dd912177c65911210c40" gracePeriod=30
Jul 20 16:00:41.852541 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.852426    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online" containerID="cri-o://d286bd65bd00783b4f5e9ec736e6938152448dc7b826c440e6d13a4be286f7c1" gracePeriod=30
Jul 20 16:00:41.852654 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:41.852352    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="registry" containerID="cri-o://b27c941df63927265d7e6f5b0d443fcebddd8eefd9ba65787c18089b494c9dfc" gracePeriod=30
Jul 20 16:00:43.076194 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.076154    2569 generic.go:356] "Generic (PLEG): container finished" podID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerID="e46e02a200e256f6ee85d7f4b595ead91e00e77c29cea2d8f7f2c014b47a1298" exitCode=0
Jul 20 16:00:43.076194 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.076185    2569 generic.go:356] "Generic (PLEG): container finished" podID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerID="288db4a2def7c48b661228899c2d2b6c6eb257b30ceea189f9deda43d9a1ae82" exitCode=0
Jul 20 16:00:43.076652 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.076222    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerDied","Data":"e46e02a200e256f6ee85d7f4b595ead91e00e77c29cea2d8f7f2c014b47a1298"}
Jul 20 16:00:43.076652 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.076262    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerDied","Data":"288db4a2def7c48b661228899c2d2b6c6eb257b30ceea189f9deda43d9a1ae82"}
Jul 20 16:00:43.079030 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.079007    2569 generic.go:356] "Generic (PLEG): container finished" podID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerID="bb3c41215771077622169aa6791d8dad5b17515be4d1af7ebea6ef44e1b677ba" exitCode=0
Jul 20 16:00:43.079030 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.079029    2569 generic.go:356] "Generic (PLEG): container finished" podID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerID="d286bd65bd00783b4f5e9ec736e6938152448dc7b826c440e6d13a4be286f7c1" exitCode=0
Jul 20 16:00:43.079211 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.079083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"bb3c41215771077622169aa6791d8dad5b17515be4d1af7ebea6ef44e1b677ba"}
Jul 20 16:00:43.079211 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.079131    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"d286bd65bd00783b4f5e9ec736e6938152448dc7b826c440e6d13a4be286f7c1"}
Jul 20 16:00:43.477856 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:43.477747    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 20 16:00:48.245977 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:48.245922    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jul 20 16:00:48.829067 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:48.829013    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jul 20 16:00:50.467408 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:50.467345    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 20 16:00:53.478284 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:53.478242    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 20 16:00:58.246195 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:58.246147    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jul 20 16:00:58.829588 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:00:58.829542    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jul 20 16:01:00.466667 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:00.466619    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 20 16:01:03.478306 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:03.478259    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 20 16:01:03.478690 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:03.478382    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 16:01:08.245709 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:08.245658    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.37:8443: connect: connection refused"
Jul 20 16:01:08.246176 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:08.245812    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 16:01:08.828790 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:08.828748    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Jul 20 16:01:08.829002 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:08.828900    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 16:01:10.467152 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:10.467105    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 20 16:01:10.467618 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:10.467217    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 16:01:12.192091 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.192056    2569 generic.go:356] "Generic (PLEG): container finished" podID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerID="76d19b633ab668c4083a5c880f366d7c53f46cfce5e282e96bb69ba55cdcc0c4" exitCode=137
Jul 20 16:01:12.192540 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.192134    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerDied","Data":"76d19b633ab668c4083a5c880f366d7c53f46cfce5e282e96bb69ba55cdcc0c4"}
Jul 20 16:01:12.195092 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.195069    2569 generic.go:356] "Generic (PLEG): container finished" podID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerID="3b0b86243e964167ce7186867f831718df42aa7cbcb9dd912177c65911210c40" exitCode=137
Jul 20 16:01:12.195092 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.195086    2569 generic.go:356] "Generic (PLEG): container finished" podID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerID="b27c941df63927265d7e6f5b0d443fcebddd8eefd9ba65787c18089b494c9dfc" exitCode=137
Jul 20 16:01:12.195281 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.195128    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"3b0b86243e964167ce7186867f831718df42aa7cbcb9dd912177c65911210c40"}
Jul 20 16:01:12.195281 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.195153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"b27c941df63927265d7e6f5b0d443fcebddd8eefd9ba65787c18089b494c9dfc"}
Jul 20 16:01:12.324204 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.324168    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 16:01:12.458024 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.457938    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-offline-tls\") pod \"ebd17247-b726-4c7e-b858-ef9f165b00bf\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") "
Jul 20 16:01:12.458150 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458027    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ebd17247-b726-4c7e-b858-ef9f165b00bf-registry-tls\") pod \"ebd17247-b726-4c7e-b858-ef9f165b00bf\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") "
Jul 20 16:01:12.458150 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458060    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls\") pod \"ebd17247-b726-4c7e-b858-ef9f165b00bf\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") "
Jul 20 16:01:12.458150 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458106    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-online-tls\") pod \"ebd17247-b726-4c7e-b858-ef9f165b00bf\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") "
Jul 20 16:01:12.458150 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458133    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65glp\" (UniqueName: \"kubernetes.io/projected/ebd17247-b726-4c7e-b858-ef9f165b00bf-kube-api-access-65glp\") pod \"ebd17247-b726-4c7e-b858-ef9f165b00bf\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") "
Jul 20 16:01:12.458345 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd17247-b726-4c7e-b858-ef9f165b00bf-feast-data\") pod \"ebd17247-b726-4c7e-b858-ef9f165b00bf\" (UID: \"ebd17247-b726-4c7e-b858-ef9f165b00bf\") "
Jul 20 16:01:12.458428 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458396    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebd17247-b726-4c7e-b858-ef9f165b00bf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ebd17247-b726-4c7e-b858-ef9f165b00bf" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:01:12.458873 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.458824    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd17247-b726-4c7e-b858-ef9f165b00bf-feast-data" (OuterVolumeSpecName: "feast-data") pod "ebd17247-b726-4c7e-b858-ef9f165b00bf" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:01:12.460369 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.460342    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-online-tls" (OuterVolumeSpecName: "online-tls") pod "ebd17247-b726-4c7e-b858-ef9f165b00bf" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.460591 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.460565    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ebd17247-b726-4c7e-b858-ef9f165b00bf" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.460591 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.460575    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ebd17247-b726-4c7e-b858-ef9f165b00bf" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.460716 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.460631    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd17247-b726-4c7e-b858-ef9f165b00bf-kube-api-access-65glp" (OuterVolumeSpecName: "kube-api-access-65glp") pod "ebd17247-b726-4c7e-b858-ef9f165b00bf" (UID: "ebd17247-b726-4c7e-b858-ef9f165b00bf"). InnerVolumeSpecName "kube-api-access-65glp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:01:12.501083 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.501058    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 16:01:12.558845 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.558789    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ebd17247-b726-4c7e-b858-ef9f165b00bf-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.558845 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.558823    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.558845 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.558849    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.559094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.558861    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65glp\" (UniqueName: \"kubernetes.io/projected/ebd17247-b726-4c7e-b858-ef9f165b00bf-kube-api-access-65glp\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.559094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.558876    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ebd17247-b726-4c7e-b858-ef9f165b00bf-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.559094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.558888    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ebd17247-b726-4c7e-b858-ef9f165b00bf-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.659721 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.659691    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-ui-tls\") pod \"0a41b3da-ac38-4de0-b652-d910899cbaf2\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") "
Jul 20 16:01:12.659913 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.659735    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a41b3da-ac38-4de0-b652-d910899cbaf2-feast-data\") pod \"0a41b3da-ac38-4de0-b652-d910899cbaf2\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") "
Jul 20 16:01:12.659913 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.659757    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-offline-tls\") pod \"0a41b3da-ac38-4de0-b652-d910899cbaf2\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") "
Jul 20 16:01:12.659913 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.659796    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls\") pod \"0a41b3da-ac38-4de0-b652-d910899cbaf2\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") "
Jul 20 16:01:12.659913 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.659853    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls\") pod \"0a41b3da-ac38-4de0-b652-d910899cbaf2\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") "
Jul 20 16:01:12.659913 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.659898    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpj66\" (UniqueName: \"kubernetes.io/projected/0a41b3da-ac38-4de0-b652-d910899cbaf2-kube-api-access-bpj66\") pod \"0a41b3da-ac38-4de0-b652-d910899cbaf2\" (UID: \"0a41b3da-ac38-4de0-b652-d910899cbaf2\") "
Jul 20 16:01:12.660382 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.660344    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a41b3da-ac38-4de0-b652-d910899cbaf2-feast-data" (OuterVolumeSpecName: "feast-data") pod "0a41b3da-ac38-4de0-b652-d910899cbaf2" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:01:12.662041 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.662012    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0a41b3da-ac38-4de0-b652-d910899cbaf2" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.662287 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.662262    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls" (OuterVolumeSpecName: "online-tls") pod "0a41b3da-ac38-4de0-b652-d910899cbaf2" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.662376 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.662278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a41b3da-ac38-4de0-b652-d910899cbaf2-kube-api-access-bpj66" (OuterVolumeSpecName: "kube-api-access-bpj66") pod "0a41b3da-ac38-4de0-b652-d910899cbaf2" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2"). InnerVolumeSpecName "kube-api-access-bpj66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:01:12.662376 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.662293    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0a41b3da-ac38-4de0-b652-d910899cbaf2" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.662515 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.662499    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0a41b3da-ac38-4de0-b652-d910899cbaf2" (UID: "0a41b3da-ac38-4de0-b652-d910899cbaf2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:01:12.761156 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.761124    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.761156 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.761155    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpj66\" (UniqueName: \"kubernetes.io/projected/0a41b3da-ac38-4de0-b652-d910899cbaf2-kube-api-access-bpj66\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.761350 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.761165    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.761350 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.761175    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0a41b3da-ac38-4de0-b652-d910899cbaf2-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.761350 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.761185    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:12.761350 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:12.761192    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0a41b3da-ac38-4de0-b652-d910899cbaf2-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:13.201472 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.201385    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"
Jul 20 16:01:13.201472 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.201388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj" event={"ID":"ebd17247-b726-4c7e-b858-ef9f165b00bf","Type":"ContainerDied","Data":"a718d6c924f370bc3945f391cc2822297fd2645efaf99ea89525cdcb6b094393"}
Jul 20 16:01:13.201472 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.201449    2569 scope.go:117] "RemoveContainer" containerID="e46e02a200e256f6ee85d7f4b595ead91e00e77c29cea2d8f7f2c014b47a1298"
Jul 20 16:01:13.204485 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.204455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf" event={"ID":"0a41b3da-ac38-4de0-b652-d910899cbaf2","Type":"ContainerDied","Data":"9af05f935e50da099bcbd7a631b6c7af7e62e0be366c79e9a7ea3cb1bea2f70b"}
Jul 20 16:01:13.204587 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.204517    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"
Jul 20 16:01:13.210479 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.210428    2569 scope.go:117] "RemoveContainer" containerID="76d19b633ab668c4083a5c880f366d7c53f46cfce5e282e96bb69ba55cdcc0c4"
Jul 20 16:01:13.218017 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.217997    2569 scope.go:117] "RemoveContainer" containerID="288db4a2def7c48b661228899c2d2b6c6eb257b30ceea189f9deda43d9a1ae82"
Jul 20 16:01:13.225525 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.225507    2569 scope.go:117] "RemoveContainer" containerID="4fed127064baf1c02031014870bd5bcdadd363dc7a0dc8328754ce4f17b77319"
Jul 20 16:01:13.232632 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.232611    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"]
Jul 20 16:01:13.233265 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.233252    2569 scope.go:117] "RemoveContainer" containerID="d8c4509f2bf79da56d9403c3ef6aabda6ec939eccfc25cc4062242852cc28f58"
Jul 20 16:01:13.240140 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.240118    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-htpnf"]
Jul 20 16:01:13.241426 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.241410    2569 scope.go:117] "RemoveContainer" containerID="bb3c41215771077622169aa6791d8dad5b17515be4d1af7ebea6ef44e1b677ba"
Jul 20 16:01:13.248959 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.248942    2569 scope.go:117] "RemoveContainer" containerID="3b0b86243e964167ce7186867f831718df42aa7cbcb9dd912177c65911210c40"
Jul 20 16:01:13.255806 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.255780    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"]
Jul 20 16:01:13.256768 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.256752    2569 scope.go:117] "RemoveContainer" containerID="d286bd65bd00783b4f5e9ec736e6938152448dc7b826c440e6d13a4be286f7c1"
Jul 20 16:01:13.263014 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.262992    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-pf2dj"]
Jul 20 16:01:13.264768 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.264747    2569 scope.go:117] "RemoveContainer" containerID="b27c941df63927265d7e6f5b0d443fcebddd8eefd9ba65787c18089b494c9dfc"
Jul 20 16:01:13.271866 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.271842    2569 scope.go:117] "RemoveContainer" containerID="9056f386d3725009db029f29a81804ecc3290f1cef09cb956fa48e20fd3d2da9"
Jul 20 16:01:13.278641 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.278622    2569 scope.go:117] "RemoveContainer" containerID="fa08b54e21939816d032a20de2a908f87a993acc371d2fb3dd40d2a30bd8b8b2"
Jul 20 16:01:13.448736 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.448698    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" path="/var/lib/kubelet/pods/0a41b3da-ac38-4de0-b652-d910899cbaf2/volumes"
Jul 20 16:01:13.449381 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:13.449346    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" path="/var/lib/kubelet/pods/ebd17247-b726-4c7e-b858-ef9f165b00bf/volumes"
Jul 20 16:01:31.670068 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:31.670032    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"]
Jul 20 16:01:31.670600 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:31.670237    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" podUID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" containerName="manager" containerID="cri-o://2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44" gracePeriod=10
Jul 20 16:01:31.926259 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:31.926188    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 16:01:32.006547 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.006505    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55f98\" (UniqueName: \"kubernetes.io/projected/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb-kube-api-access-55f98\") pod \"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb\" (UID: \"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb\") "
Jul 20 16:01:32.008702 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.008672    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb-kube-api-access-55f98" (OuterVolumeSpecName: "kube-api-access-55f98") pod "d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" (UID: "d7870f77-0fa4-4e52-b4a6-00fd5465c7cb"). InnerVolumeSpecName "kube-api-access-55f98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:01:32.107281 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.107225    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55f98\" (UniqueName: \"kubernetes.io/projected/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb-kube-api-access-55f98\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:01:32.278129 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.278094    2569 generic.go:356] "Generic (PLEG): container finished" podID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" containerID="2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44" exitCode=0
Jul 20 16:01:32.278331 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.278141    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"
Jul 20 16:01:32.278331 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.278161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" event={"ID":"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb","Type":"ContainerDied","Data":"2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44"}
Jul 20 16:01:32.278331 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.278213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" event={"ID":"d7870f77-0fa4-4e52-b4a6-00fd5465c7cb","Type":"ContainerDied","Data":"27aa9f5016b91cd72ffb18f939b2e58de68939eb6dbf48a88738e16c926ec15f"}
Jul 20 16:01:32.278331 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.278242    2569 scope.go:117] "RemoveContainer" containerID="2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44"
Jul 20 16:01:32.286352 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.286331    2569 scope.go:117] "RemoveContainer" containerID="2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44"
Jul 20 16:01:32.286628 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:01:32.286612    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44\": container with ID starting with 2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44 not found: ID does not exist" containerID="2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44"
Jul 20 16:01:32.286674 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.286638    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44"} err="failed to get container status \"2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44\": rpc error: code = NotFound desc = could not find container \"2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44\": container with ID starting with 2e6bcdee5e52b8d9edc2b36af64ed1fbd84f3229df56d4a1ae0a1d26ca4f5c44 not found: ID does not exist"
Jul 20 16:01:32.300649 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.300613    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"]
Jul 20 16:01:32.311295 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.311267    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx"]
Jul 20 16:01:32.867671 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:32.867627    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-ng4lx" podUID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.34:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 16:01:33.442181 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:33.442146    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" path="/var/lib/kubelet/pods/d7870f77-0fa4-4e52-b4a6-00fd5465c7cb/volumes"
Jul 20 16:01:36.636321 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636280    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"]
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636545    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" containerName="manager"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636555    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" containerName="manager"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636570    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="feast-apply"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636575    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="feast-apply"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636583    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636589    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636596    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="feast-init"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636601    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="feast-init"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636607    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="feast-apply"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636613    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="feast-apply"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636623    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636628    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636635    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636640    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636645    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="offline"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636650    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="offline"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636657    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="registry"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636662    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="registry"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636667    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="offline"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636672    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="offline"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636677    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636683    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636691    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="feast-init"
Jul 20 16:01:36.636718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636695    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="feast-init"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636738    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="ui"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636746    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7870f77-0fa4-4e52-b4a6-00fd5465c7cb" containerName="manager"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636751    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="ui"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636756    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="registry"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636762    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="offline"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636768    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="online"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636772    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a41b3da-ac38-4de0-b652-d910899cbaf2" containerName="offline"
Jul 20 16:01:36.637464 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.636777    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd17247-b726-4c7e-b858-ef9f165b00bf" containerName="online"
Jul 20 16:01:36.639459 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.639442    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:36.641587 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.641562    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 20 16:01:36.642100 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.642080    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-jgk78\""
Jul 20 16:01:36.642202 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.642111    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 20 16:01:36.653449 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.653425    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"]
Jul 20 16:01:36.743655 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.743618    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr75g\" (UniqueName: \"kubernetes.io/projected/966f138a-1f78-4b8d-ab3d-39d0980bd9e1-kube-api-access-wr75g\") pod \"feast-operator-controller-manager-7495bcd-4rls7\" (UID: \"966f138a-1f78-4b8d-ab3d-39d0980bd9e1\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:36.844078 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.844036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr75g\" (UniqueName: \"kubernetes.io/projected/966f138a-1f78-4b8d-ab3d-39d0980bd9e1-kube-api-access-wr75g\") pod \"feast-operator-controller-manager-7495bcd-4rls7\" (UID: \"966f138a-1f78-4b8d-ab3d-39d0980bd9e1\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:36.853721 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.853683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr75g\" (UniqueName: \"kubernetes.io/projected/966f138a-1f78-4b8d-ab3d-39d0980bd9e1-kube-api-access-wr75g\") pod \"feast-operator-controller-manager-7495bcd-4rls7\" (UID: \"966f138a-1f78-4b8d-ab3d-39d0980bd9e1\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:36.948903 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:36.948785    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:37.093617 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:37.093591    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"]
Jul 20 16:01:37.096138 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:01:37.096109    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966f138a_1f78_4b8d_ab3d_39d0980bd9e1.slice/crio-e7edc77d7a09eea05e4d6b5d4e681e92ec3f04aa152d7587cd71bcd829be0e95 WatchSource:0}: Error finding container e7edc77d7a09eea05e4d6b5d4e681e92ec3f04aa152d7587cd71bcd829be0e95: Status 404 returned error can't find the container with id e7edc77d7a09eea05e4d6b5d4e681e92ec3f04aa152d7587cd71bcd829be0e95
Jul 20 16:01:37.303807 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:37.303769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7" event={"ID":"966f138a-1f78-4b8d-ab3d-39d0980bd9e1","Type":"ContainerStarted","Data":"1aa6551ffcc930b0d4a90c86f066eb66409acd303ee66535349f0693f6a0aaac"}
Jul 20 16:01:37.304052 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:37.303853    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7" event={"ID":"966f138a-1f78-4b8d-ab3d-39d0980bd9e1","Type":"ContainerStarted","Data":"e7edc77d7a09eea05e4d6b5d4e681e92ec3f04aa152d7587cd71bcd829be0e95"}
Jul 20 16:01:37.304052 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:37.303887    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:37.335866 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:37.335799    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7" podStartSLOduration=1.335784519 podStartE2EDuration="1.335784519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:01:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:01:37.332872197 +0000 UTC m=+1410.447722275" watchObservedRunningTime="2026-07-20 16:01:37.335784519 +0000 UTC m=+1410.450634639"
Jul 20 16:01:48.310990 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:48.310957    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-4rls7"
Jul 20 16:01:53.434057 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.433989    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"]
Jul 20 16:01:53.437849 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.437819    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.439979 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.439959    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 20 16:01:53.440324 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.440304    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-kckm9\""
Jul 20 16:01:53.440441 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.440368    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 20 16:01:53.440441 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.440373    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 20 16:01:53.440772 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.440758    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 20 16:01:53.440902 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.440791    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 20 16:01:53.443756 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.443738    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 20 16:01:53.455855 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.455816    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"]
Jul 20 16:01:53.481618 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.481590    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf6e856-195b-4729-b409-f785a553ea2e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.481770 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.481633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.481770 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.481670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhw2f\" (UniqueName: \"kubernetes.io/projected/1cf6e856-195b-4729-b409-f785a553ea2e-kube-api-access-dhw2f\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.481770 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.481692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.481770 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.481711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.481770 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.481734    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.582534 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.582498    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.582705 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.582570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf6e856-195b-4729-b409-f785a553ea2e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.582705 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.582612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.582705 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.582651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhw2f\" (UniqueName: \"kubernetes.io/projected/1cf6e856-195b-4729-b409-f785a553ea2e-kube-api-access-dhw2f\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.582705 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.582678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.583002 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.582707    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.583002 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:01:53.582894    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 16:01:53.583002 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:01:53.582978    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls podName:1cf6e856-195b-4729-b409-f785a553ea2e nodeName:}" failed. No retries permitted until 2026-07-20 16:01:54.082954954 +0000 UTC m=+1427.197805018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls") pod "feast-simple-feast-setup-777d6cc998-z8gmj" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 16:01:53.583188 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.583065    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf6e856-195b-4729-b409-f785a553ea2e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.585177 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.585148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.585476 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.585460    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.585648 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.585628    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:53.593928 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:53.593906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhw2f\" (UniqueName: \"kubernetes.io/projected/1cf6e856-195b-4729-b409-f785a553ea2e-kube-api-access-dhw2f\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:54.087067 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:54.087026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:54.089484 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:54.089461    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-z8gmj\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:54.355062 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:54.354979    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:01:54.497246 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:54.497218    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"]
Jul 20 16:01:54.499324 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:01:54.499296    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cf6e856_195b_4729_b409_f785a553ea2e.slice/crio-5208a77d75154648d8ace7d5349ab11757e1e1400f2b048af13548abc2eb0c2e WatchSource:0}: Error finding container 5208a77d75154648d8ace7d5349ab11757e1e1400f2b048af13548abc2eb0c2e: Status 404 returned error can't find the container with id 5208a77d75154648d8ace7d5349ab11757e1e1400f2b048af13548abc2eb0c2e
Jul 20 16:01:55.377533 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:55.377491    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"175512092f6f07878c050a2f54030c425ffc4203b9da3a85d75736f754b9bb5e"}
Jul 20 16:01:55.377724 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:55.377548    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"5208a77d75154648d8ace7d5349ab11757e1e1400f2b048af13548abc2eb0c2e"}
Jul 20 16:01:59.393114 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:59.393084    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cf6e856-195b-4729-b409-f785a553ea2e" containerID="175512092f6f07878c050a2f54030c425ffc4203b9da3a85d75736f754b9bb5e" exitCode=0
Jul 20 16:01:59.393438 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:01:59.393121    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"175512092f6f07878c050a2f54030c425ffc4203b9da3a85d75736f754b9bb5e"}
Jul 20 16:02:00.399192 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:00.399154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"9200c450510a31dfd63f3445679e65800e409b705a9e592cfaffe287fd8071e8"}
Jul 20 16:02:05.419588 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:05.419550    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cf6e856-195b-4729-b409-f785a553ea2e" containerID="9200c450510a31dfd63f3445679e65800e409b705a9e592cfaffe287fd8071e8" exitCode=0
Jul 20 16:02:05.420002 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:05.419594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"9200c450510a31dfd63f3445679e65800e409b705a9e592cfaffe287fd8071e8"}
Jul 20 16:02:06.430755 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:06.430714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"7bb64eef0170ba961159388fffacf313fa42658e4234804e5465ff6ed7be93bd"}
Jul 20 16:02:06.431288 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:06.430777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"7d217f8463653f04084016366386bc6a2da6d345f444aaf931fc97cec9afe71f"}
Jul 20 16:02:06.431288 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:06.430798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"aff7e97edc102d9f09a1809fc7de64fbd1a1b3a5248092ad86be540df21dae95"}
Jul 20 16:02:06.431288 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:06.430815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerStarted","Data":"0ad30bda3cf483c8bdeaa1d6ce592b4403d0c41166e18e5b6b50f448c7c0c93e"}
Jul 20 16:02:06.459023 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:06.458945    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podStartSLOduration=13.458920416 podStartE2EDuration="13.458920416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:01:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:02:06.456060191 +0000 UTC m=+1439.570910277" watchObservedRunningTime="2026-07-20 16:02:06.458920416 +0000 UTC m=+1439.573770504"
Jul 20 16:02:09.355490 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.355443    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:09.356101 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.356075    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:09.356101 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.356108    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:09.356312 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.356128    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:09.357626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.357591    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.39:8816: connect: connection refused"
Jul 20 16:02:09.357860 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.357633    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Jul 20 16:02:09.357951 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.357602    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.39:6571: connect: connection refused"
Jul 20 16:02:09.357951 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:09.357655    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Jul 20 16:02:12.356492 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.356457    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.356996 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.356595    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.356996 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.356825    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.357324 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.357302    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.357475 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.357455    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.357580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.357482    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.357580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.357539    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.357663 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.357589    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.357783 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.357765    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.362099 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.362084    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.464189 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.464147    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:02:12.467491 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:02:12.467472    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:03:14.660539 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.660502    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"]
Jul 20 16:03:14.661186 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.660737    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="registry" containerID="cri-o://0ad30bda3cf483c8bdeaa1d6ce592b4403d0c41166e18e5b6b50f448c7c0c93e" gracePeriod=30
Jul 20 16:03:14.661186 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.660803    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="offline" containerID="cri-o://7d217f8463653f04084016366386bc6a2da6d345f444aaf931fc97cec9afe71f" gracePeriod=30
Jul 20 16:03:14.661186 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.660850    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui" containerID="cri-o://7bb64eef0170ba961159388fffacf313fa42658e4234804e5465ff6ed7be93bd" gracePeriod=30
Jul 20 16:03:14.661186 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.660818    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online" containerID="cri-o://aff7e97edc102d9f09a1809fc7de64fbd1a1b3a5248092ad86be540df21dae95" gracePeriod=30
Jul 20 16:03:14.979551 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.979440    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"]
Jul 20 16:03:14.984474 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.984443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:14.991177 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.991147    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4lqrb\""
Jul 20 16:03:15.000683 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:14.999556    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"]
Jul 20 16:03:15.081920 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.081875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.082236 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.082204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.082376 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.082296    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.082376 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.082333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.082490 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.082375    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.082490 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.082405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mppq\" (UniqueName: \"kubernetes.io/projected/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-kube-api-access-9mppq\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183318 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.183268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183318 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.183317    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.183348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.183372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mppq\" (UniqueName: \"kubernetes.io/projected/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-kube-api-access-9mppq\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:03:15.183406    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.183426    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.183464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:03:15.183488    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls podName:b3c05bea-e6f1-4bb1-8824-4b31ff448d33 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:15.683464025 +0000 UTC m=+1508.798314089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls") pod "feast-simple-feast-setup-777d6cc998-vhpvp" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 20 16:03:15.183603 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:03:15.183582    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 16:03:15.183988 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:03:15.183631    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls podName:b3c05bea-e6f1-4bb1-8824-4b31ff448d33 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:15.683615195 +0000 UTC m=+1508.798465275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls") pod "feast-simple-feast-setup-777d6cc998-vhpvp" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 16:03:15.184590 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.184517    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.186655 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.186630    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.187310 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.187246    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.196888 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.196863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mppq\" (UniqueName: \"kubernetes.io/projected/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-kube-api-access-9mppq\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.688637 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.688600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.689154 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.688687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.689154 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:03:15.688787    2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 16:03:15.689154 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:03:15.688855    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls podName:b3c05bea-e6f1-4bb1-8824-4b31ff448d33 nodeName:}" failed. No retries permitted until 2026-07-20 16:03:16.688826173 +0000 UTC m=+1509.803676236 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls") pod "feast-simple-feast-setup-777d6cc998-vhpvp" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 20 16:03:15.691164 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.691143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:15.705356 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.705326    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cf6e856-195b-4729-b409-f785a553ea2e" containerID="7bb64eef0170ba961159388fffacf313fa42658e4234804e5465ff6ed7be93bd" exitCode=0
Jul 20 16:03:15.705356 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.705349    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cf6e856-195b-4729-b409-f785a553ea2e" containerID="aff7e97edc102d9f09a1809fc7de64fbd1a1b3a5248092ad86be540df21dae95" exitCode=0
Jul 20 16:03:15.705578 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.705378    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"7bb64eef0170ba961159388fffacf313fa42658e4234804e5465ff6ed7be93bd"}
Jul 20 16:03:15.705578 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:15.705413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"aff7e97edc102d9f09a1809fc7de64fbd1a1b3a5248092ad86be540df21dae95"}
Jul 20 16:03:16.698807 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:16.698766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:16.701160 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:16.701140    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-vhpvp\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:16.811381 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:16.811342    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:16.947513 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:16.947491    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"]
Jul 20 16:03:16.949475 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:03:16.949411    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3c05bea_e6f1_4bb1_8824_4b31ff448d33.slice/crio-62f1284359bd5a5ba6dbdba4caa0a0173c2ca79b62e1afcd0be6637ab16b7b01 WatchSource:0}: Error finding container 62f1284359bd5a5ba6dbdba4caa0a0173c2ca79b62e1afcd0be6637ab16b7b01: Status 404 returned error can't find the container with id 62f1284359bd5a5ba6dbdba4caa0a0173c2ca79b62e1afcd0be6637ab16b7b01
Jul 20 16:03:17.714743 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:17.714705    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"}
Jul 20 16:03:17.715219 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:17.714755    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"62f1284359bd5a5ba6dbdba4caa0a0173c2ca79b62e1afcd0be6637ab16b7b01"}
Jul 20 16:03:22.357575 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:22.357525    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Jul 20 16:03:22.465047 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:22.465007    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Jul 20 16:03:22.735711 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:22.735628    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerID="f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681" exitCode=0
Jul 20 16:03:22.735892 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:22.735704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"}
Jul 20 16:03:23.741270 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:23.741235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"}
Jul 20 16:03:28.763535 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:28.763499    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerID="76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5" exitCode=0
Jul 20 16:03:28.763535 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:28.763540    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"}
Jul 20 16:03:29.773587 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:29.773549    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"}
Jul 20 16:03:29.774084 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:29.773612    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"}
Jul 20 16:03:29.774084 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:29.773634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"}
Jul 20 16:03:29.774084 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:29.773651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerStarted","Data":"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"}
Jul 20 16:03:29.806173 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:29.806112    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podStartSLOduration=15.806090166 podStartE2EDuration="15.806090166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:03:29.804219383 +0000 UTC m=+1522.919069472" watchObservedRunningTime="2026-07-20 16:03:29.806090166 +0000 UTC m=+1522.920940255"
Jul 20 16:03:31.813573 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.812551    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:31.813573 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.812619    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:31.813573 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.812640    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:31.813573 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.812657    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:31.814867 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.814674    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Jul 20 16:03:31.814867 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.814703    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Jul 20 16:03:31.814867 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.814709    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.40:6571: connect: connection refused"
Jul 20 16:03:31.814867 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:31.814679    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.40:8816: connect: connection refused"
Jul 20 16:03:32.357929 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:32.357632    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Jul 20 16:03:32.465118 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:32.465058    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Jul 20 16:03:34.811903 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.811855    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Jul 20 16:03:34.812857 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.812817    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:34.813075 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.813060    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:34.813448 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.813421    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:34.813679 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.813467    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:34.813803 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.813785    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:34.815017 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.814993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:34.866302 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:34.866265    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:35.806671 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:35.806639    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:35.809871 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:35.809827    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:36.812462 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:36.812428    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:37.812108 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:37.812083    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:37.814327 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:37.814302    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:03:42.357698 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:42.357657    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Jul 20 16:03:42.358189 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:42.357798    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:03:42.464816 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:42.464772    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Jul 20 16:03:42.465029 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:42.464923    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:03:44.846748 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:44.846717    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cf6e856-195b-4729-b409-f785a553ea2e" containerID="7d217f8463653f04084016366386bc6a2da6d345f444aaf931fc97cec9afe71f" exitCode=137
Jul 20 16:03:44.846748 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:44.846740    2569 generic.go:356] "Generic (PLEG): container finished" podID="1cf6e856-195b-4729-b409-f785a553ea2e" containerID="0ad30bda3cf483c8bdeaa1d6ce592b4403d0c41166e18e5b6b50f448c7c0c93e" exitCode=137
Jul 20 16:03:44.847199 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:44.846792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"7d217f8463653f04084016366386bc6a2da6d345f444aaf931fc97cec9afe71f"}
Jul 20 16:03:44.847199 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:44.846852    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"0ad30bda3cf483c8bdeaa1d6ce592b4403d0c41166e18e5b6b50f448c7c0c93e"}
Jul 20 16:03:45.310620 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.310596    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:03:45.461046 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.460957    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf6e856-195b-4729-b409-f785a553ea2e-feast-data\") pod \"1cf6e856-195b-4729-b409-f785a553ea2e\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") "
Jul 20 16:03:45.461046 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.461007    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-ui-tls\") pod \"1cf6e856-195b-4729-b409-f785a553ea2e\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") "
Jul 20 16:03:45.461046 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.461044    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls\") pod \"1cf6e856-195b-4729-b409-f785a553ea2e\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") "
Jul 20 16:03:45.461343 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.461087    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-registry-tls\") pod \"1cf6e856-195b-4729-b409-f785a553ea2e\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") "
Jul 20 16:03:45.461343 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.461135    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhw2f\" (UniqueName: \"kubernetes.io/projected/1cf6e856-195b-4729-b409-f785a553ea2e-kube-api-access-dhw2f\") pod \"1cf6e856-195b-4729-b409-f785a553ea2e\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") "
Jul 20 16:03:45.461343 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.461157    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-online-tls\") pod \"1cf6e856-195b-4729-b409-f785a553ea2e\" (UID: \"1cf6e856-195b-4729-b409-f785a553ea2e\") "
Jul 20 16:03:45.461546 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.461512    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf6e856-195b-4729-b409-f785a553ea2e-feast-data" (OuterVolumeSpecName: "feast-data") pod "1cf6e856-195b-4729-b409-f785a553ea2e" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:03:45.463457 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.463420    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1cf6e856-195b-4729-b409-f785a553ea2e" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:45.463559 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.463500    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1cf6e856-195b-4729-b409-f785a553ea2e" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:45.463559 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.463542    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-online-tls" (OuterVolumeSpecName: "online-tls") pod "1cf6e856-195b-4729-b409-f785a553ea2e" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:45.463675 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.463630    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1cf6e856-195b-4729-b409-f785a553ea2e" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:03:45.463675 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.463639    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf6e856-195b-4729-b409-f785a553ea2e-kube-api-access-dhw2f" (OuterVolumeSpecName: "kube-api-access-dhw2f") pod "1cf6e856-195b-4729-b409-f785a553ea2e" (UID: "1cf6e856-195b-4729-b409-f785a553ea2e"). InnerVolumeSpecName "kube-api-access-dhw2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:03:45.561916 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.561873    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:03:45.561916 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.561908    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1cf6e856-195b-4729-b409-f785a553ea2e-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:03:45.561916 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.561920    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:03:45.562168 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.561932    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:03:45.562168 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.561943    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1cf6e856-195b-4729-b409-f785a553ea2e-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:03:45.562168 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.561954    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhw2f\" (UniqueName: \"kubernetes.io/projected/1cf6e856-195b-4729-b409-f785a553ea2e-kube-api-access-dhw2f\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:03:45.852965 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.852929    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj" event={"ID":"1cf6e856-195b-4729-b409-f785a553ea2e","Type":"ContainerDied","Data":"5208a77d75154648d8ace7d5349ab11757e1e1400f2b048af13548abc2eb0c2e"}
Jul 20 16:03:45.853550 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.852978    2569 scope.go:117] "RemoveContainer" containerID="7bb64eef0170ba961159388fffacf313fa42658e4234804e5465ff6ed7be93bd"
Jul 20 16:03:45.853550 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.852992    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"
Jul 20 16:03:45.862195 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.862174    2569 scope.go:117] "RemoveContainer" containerID="7d217f8463653f04084016366386bc6a2da6d345f444aaf931fc97cec9afe71f"
Jul 20 16:03:45.869657 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.869632    2569 scope.go:117] "RemoveContainer" containerID="aff7e97edc102d9f09a1809fc7de64fbd1a1b3a5248092ad86be540df21dae95"
Jul 20 16:03:45.877213 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.877191    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"]
Jul 20 16:03:45.877584 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.877560    2569 scope.go:117] "RemoveContainer" containerID="0ad30bda3cf483c8bdeaa1d6ce592b4403d0c41166e18e5b6b50f448c7c0c93e"
Jul 20 16:03:45.882242 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.882217    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-z8gmj"]
Jul 20 16:03:45.885287 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.885271    2569 scope.go:117] "RemoveContainer" containerID="9200c450510a31dfd63f3445679e65800e409b705a9e592cfaffe287fd8071e8"
Jul 20 16:03:45.891990 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:45.891975    2569 scope.go:117] "RemoveContainer" containerID="175512092f6f07878c050a2f54030c425ffc4203b9da3a85d75736f754b9bb5e"
Jul 20 16:03:47.442564 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:03:47.442531    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" path="/var/lib/kubelet/pods/1cf6e856-195b-4729-b409-f785a553ea2e/volumes"
Jul 20 16:04:40.321416 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321380    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"]
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321663    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="offline"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321674    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="offline"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321684    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="registry"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321690    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="registry"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321699    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="feast-init"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321704    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="feast-init"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321711    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="feast-apply"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321716    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="feast-apply"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321724    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321729    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321737    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321741    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321782    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="registry"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321790    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="offline"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321795    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="online"
Jul 20 16:04:40.321918 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.321802    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf6e856-195b-4729-b409-f785a553ea2e" containerName="ui"
Jul 20 16:04:40.325019 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.325002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.327147 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327114    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 20 16:04:40.327317 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327184    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 20 16:04:40.327317 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327186    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 20 16:04:40.327317 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327231    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 20 16:04:40.327508 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327447    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-cd986\""
Jul 20 16:04:40.327566 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327516    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 20 16:04:40.327566 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.327532    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 20 16:04:40.330860 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.330823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.331087 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.331063    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.331212 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.331107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.331212 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.331131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.331212 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.331191    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.331387 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.331219    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnvtm\" (UniqueName: \"kubernetes.io/projected/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-kube-api-access-bnvtm\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.339768 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.339745    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"]
Jul 20 16:04:40.432104 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnvtm\" (UniqueName: \"kubernetes.io/projected/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-kube-api-access-bnvtm\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432335 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:04:40.432296    2569 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 20 16:04:40.432653 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:04:40.432381    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls podName:5f7c26f3-c7f0-4498-90b2-5d97db28c4c8 nodeName:}" failed. No retries permitted until 2026-07-20 16:04:40.932359109 +0000 UTC m=+1594.047209175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls") pod "feast-simple-feast-remote-setup-db6955c6c-rrvth" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 20 16:04:40.432653 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432538    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.432960 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.432935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.434827 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.434799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.434961 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.434847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.441961 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.441938    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnvtm\" (UniqueName: \"kubernetes.io/projected/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-kube-api-access-bnvtm\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.935882 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.935816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:40.938191 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:40.938168    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-rrvth\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:41.234788 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:41.234678    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:41.371644 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:41.371619    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"]
Jul 20 16:04:41.373667 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:04:41.373638    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f7c26f3_c7f0_4498_90b2_5d97db28c4c8.slice/crio-2f6712946d92462c6e16e6e35af8bf761a9871477c0a06a8f50a1bdc040ffb76 WatchSource:0}: Error finding container 2f6712946d92462c6e16e6e35af8bf761a9871477c0a06a8f50a1bdc040ffb76: Status 404 returned error can't find the container with id 2f6712946d92462c6e16e6e35af8bf761a9871477c0a06a8f50a1bdc040ffb76
Jul 20 16:04:42.076051 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:42.076019    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerStarted","Data":"6ce8d1834c0c77d8c06972b4ed846c7c9b69bda22f93ad658303d72a2a374947"}
Jul 20 16:04:42.076252 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:42.076061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerStarted","Data":"2f6712946d92462c6e16e6e35af8bf761a9871477c0a06a8f50a1bdc040ffb76"}
Jul 20 16:04:47.096673 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:47.096637    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerID="6ce8d1834c0c77d8c06972b4ed846c7c9b69bda22f93ad658303d72a2a374947" exitCode=0
Jul 20 16:04:47.097254 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:47.096714    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerDied","Data":"6ce8d1834c0c77d8c06972b4ed846c7c9b69bda22f93ad658303d72a2a374947"}
Jul 20 16:04:48.102455 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:48.102420    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerStarted","Data":"202d2f36bffa6f40add7f384c2f0df7cb1847662f0dd33f7c839b15b78557d7e"}
Jul 20 16:04:53.126297 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:53.126265    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerID="202d2f36bffa6f40add7f384c2f0df7cb1847662f0dd33f7c839b15b78557d7e" exitCode=0
Jul 20 16:04:53.126656 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:53.126335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerDied","Data":"202d2f36bffa6f40add7f384c2f0df7cb1847662f0dd33f7c839b15b78557d7e"}
Jul 20 16:04:54.134297 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:54.134259    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerStarted","Data":"04debca1e6e8607ea6449fcccc6d02d5231bc3d22708703ed0b7f9a961e45f99"}
Jul 20 16:04:54.134774 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:54.134311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerStarted","Data":"bead074ffb155a76dfba2ca6268daff0f19ad68f9a30032a19c4287b3eb4143d"}
Jul 20 16:04:54.134774 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:54.134323    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerStarted","Data":"2232092c04eaee80570f4474dfc36f47c0edbeb57f3b127ad1101206bfef43de"}
Jul 20 16:04:54.173281 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:54.173217    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podStartSLOduration=14.173197779 podStartE2EDuration="14.173197779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:04:54.166771867 +0000 UTC m=+1607.281621951" watchObservedRunningTime="2026-07-20 16:04:54.173197779 +0000 UTC m=+1607.288047863"
Jul 20 16:04:56.235416 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:56.235298    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:56.235416 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:56.235400    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:56.235416 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:56.235426    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:56.237528 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:56.237487    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.41:8443: connect: connection refused"
Jul 20 16:04:56.237704 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:56.237535    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.41:6567/health\": dial tcp 10.133.0.41:6567: connect: connection refused"
Jul 20 16:04:56.237704 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:56.237500    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.41:8816: connect: connection refused"
Jul 20 16:04:59.236011 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:59.235915    2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.41:8443: connect: connection refused"
Jul 20 16:04:59.236971 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:59.236941    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:59.237442 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:59.237420    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:59.237807 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:59.237789    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:04:59.243477 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:04:59.243454    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:05:00.159974 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:05:00.159938    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:05:00.164683 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:05:00.164659    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:05:01.235278 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:05:01.235239    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:05:02.236474 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:05:02.236444    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:05:03.171995 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:05:03.171971    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:06:05.370165 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.370125    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"]
Jul 20 16:06:05.370780 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.370354    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online" containerID="cri-o://2232092c04eaee80570f4474dfc36f47c0edbeb57f3b127ad1101206bfef43de" gracePeriod=30
Jul 20 16:06:05.370780 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.370434    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="offline" containerID="cri-o://bead074ffb155a76dfba2ca6268daff0f19ad68f9a30032a19c4287b3eb4143d" gracePeriod=30
Jul 20 16:06:05.370780 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.370431    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui" containerID="cri-o://04debca1e6e8607ea6449fcccc6d02d5231bc3d22708703ed0b7f9a961e45f99" gracePeriod=30
Jul 20 16:06:05.521908 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.521875    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"]
Jul 20 16:06:05.522421 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.522166    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="registry" containerID="cri-o://f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b" gracePeriod=30
Jul 20 16:06:05.522421 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.522229    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="offline" containerID="cri-o://ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad" gracePeriod=30
Jul 20 16:06:05.522421 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.522271    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online" containerID="cri-o://c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30" gracePeriod=30
Jul 20 16:06:05.522421 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.522229    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui" containerID="cri-o://d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0" gracePeriod=30
Jul 20 16:06:05.807689 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:05.807648    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Jul 20 16:06:06.412361 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.412325    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerID="04debca1e6e8607ea6449fcccc6d02d5231bc3d22708703ed0b7f9a961e45f99" exitCode=0
Jul 20 16:06:06.412361 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.412353    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerID="2232092c04eaee80570f4474dfc36f47c0edbeb57f3b127ad1101206bfef43de" exitCode=0
Jul 20 16:06:06.412844 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.412394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerDied","Data":"04debca1e6e8607ea6449fcccc6d02d5231bc3d22708703ed0b7f9a961e45f99"}
Jul 20 16:06:06.412844 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.412439    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerDied","Data":"2232092c04eaee80570f4474dfc36f47c0edbeb57f3b127ad1101206bfef43de"}
Jul 20 16:06:06.415156 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.415134    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerID="d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0" exitCode=0
Jul 20 16:06:06.415156 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.415155    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerID="c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30" exitCode=0
Jul 20 16:06:06.415306 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.415172    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"}
Jul 20 16:06:06.415306 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:06.415197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"}
Jul 20 16:06:07.814115 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:07.814072    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Jul 20 16:06:10.160488 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:10.160447    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.41:6567/health\": dial tcp 10.133.0.41:6567: connect: connection refused"
Jul 20 16:06:13.172437 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:13.172393    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.41:8443: connect: connection refused"
Jul 20 16:06:15.807439 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:15.807394    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Jul 20 16:06:17.814098 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:17.814056    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Jul 20 16:06:20.160368 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:20.160323    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.41:6567/health\": dial tcp 10.133.0.41:6567: connect: connection refused"
Jul 20 16:06:23.172257 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:23.172196    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.41:8443: connect: connection refused"
Jul 20 16:06:25.807816 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:25.807775    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Jul 20 16:06:25.808255 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:25.807913    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:06:27.814825 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:27.814780    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Jul 20 16:06:27.815263 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:27.814931    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:06:30.160730 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:30.160634    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online" probeResult="failure" output="Get \"https://10.133.0.41:6567/health\": dial tcp 10.133.0.41:6567: connect: connection refused"
Jul 20 16:06:30.161145 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:30.160765    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:06:33.172425 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:33.172377    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.41:8443: connect: connection refused"
Jul 20 16:06:33.172879 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:33.172510    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:06:35.526301 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.526276    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerID="bead074ffb155a76dfba2ca6268daff0f19ad68f9a30032a19c4287b3eb4143d" exitCode=137
Jul 20 16:06:35.526673 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.526335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerDied","Data":"bead074ffb155a76dfba2ca6268daff0f19ad68f9a30032a19c4287b3eb4143d"}
Jul 20 16:06:35.637229 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.637167    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:06:35.713685 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.713652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-ui-tls\") pod \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") "
Jul 20 16:06:35.713909 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.713726    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnvtm\" (UniqueName: \"kubernetes.io/projected/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-kube-api-access-bnvtm\") pod \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") "
Jul 20 16:06:35.713909 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.713765    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-feast-data\") pod \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") "
Jul 20 16:06:35.713909 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.713792    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-registry-tls\") pod \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") "
Jul 20 16:06:35.714084 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.713934    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-online-tls\") pod \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") "
Jul 20 16:06:35.714084 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.713969    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls\") pod \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\" (UID: \"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8\") "
Jul 20 16:06:35.714180 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.714151    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 16:06:35.714329 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.714309    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-feast-data" (OuterVolumeSpecName: "feast-data") pod "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:06:35.716115 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.716086    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-kube-api-access-bnvtm" (OuterVolumeSpecName: "kube-api-access-bnvtm") pod "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8"). InnerVolumeSpecName "kube-api-access-bnvtm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:06:35.716277 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.716254    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:35.716335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.716270    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-online-tls" (OuterVolumeSpecName: "online-tls") pod "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:35.716335 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.716285    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" (UID: "5f7c26f3-c7f0-4498-90b2-5d97db28c4c8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:35.807028 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.806983    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Jul 20 16:06:35.815047 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.815027    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:35.815047 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.815050    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:35.815157 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.815059    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:35.815157 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.815068    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnvtm\" (UniqueName: \"kubernetes.io/projected/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-kube-api-access-bnvtm\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:35.815157 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.815079    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:35.815157 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:35.815087    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.175977 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.175950    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:06:36.318868 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.318727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mppq\" (UniqueName: \"kubernetes.io/projected/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-kube-api-access-9mppq\") pod \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") "
Jul 20 16:06:36.318868 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.318788    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls\") pod \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") "
Jul 20 16:06:36.319127 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.318884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-feast-data\") pod \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") "
Jul 20 16:06:36.319127 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.318912    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-ui-tls\") pod \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") "
Jul 20 16:06:36.319127 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.318949    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-online-tls\") pod \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") "
Jul 20 16:06:36.319127 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.318997    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") pod \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\" (UID: \"b3c05bea-e6f1-4bb1-8824-4b31ff448d33\") "
Jul 20 16:06:36.319532 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.319482    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-feast-data" (OuterVolumeSpecName: "feast-data") pod "b3c05bea-e6f1-4bb1-8824-4b31ff448d33" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:06:36.321088 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.321060    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-online-tls" (OuterVolumeSpecName: "online-tls") pod "b3c05bea-e6f1-4bb1-8824-4b31ff448d33" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:36.321214 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.321096    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b3c05bea-e6f1-4bb1-8824-4b31ff448d33" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:36.321321 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.321295    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b3c05bea-e6f1-4bb1-8824-4b31ff448d33" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:36.321416 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.321356    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-kube-api-access-9mppq" (OuterVolumeSpecName: "kube-api-access-9mppq") pod "b3c05bea-e6f1-4bb1-8824-4b31ff448d33" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33"). InnerVolumeSpecName "kube-api-access-9mppq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:06:36.321416 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.321371    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b3c05bea-e6f1-4bb1-8824-4b31ff448d33" (UID: "b3c05bea-e6f1-4bb1-8824-4b31ff448d33"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 16:06:36.420168 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.420131    2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-feast-data\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.420168 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.420162    2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-ui-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.420168 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.420171    2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-online-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.420404 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.420186    2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-offline-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.420404 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.420195    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mppq\" (UniqueName: \"kubernetes.io/projected/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-kube-api-access-9mppq\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.420404 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.420204    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b3c05bea-e6f1-4bb1-8824-4b31ff448d33-registry-tls\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:06:36.532516 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.532488    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"
Jul 20 16:06:36.532516 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.532503    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth" event={"ID":"5f7c26f3-c7f0-4498-90b2-5d97db28c4c8","Type":"ContainerDied","Data":"2f6712946d92462c6e16e6e35af8bf761a9871477c0a06a8f50a1bdc040ffb76"}
Jul 20 16:06:36.533108 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.532553    2569 scope.go:117] "RemoveContainer" containerID="04debca1e6e8607ea6449fcccc6d02d5231bc3d22708703ed0b7f9a961e45f99"
Jul 20 16:06:36.535740 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.535696    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerID="ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad" exitCode=137
Jul 20 16:06:36.535740 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.535723    2569 generic.go:356] "Generic (PLEG): container finished" podID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerID="f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b" exitCode=137
Jul 20 16:06:36.535941 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.535758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"}
Jul 20 16:06:36.535941 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.535775    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"
Jul 20 16:06:36.535941 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.535797    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"}
Jul 20 16:06:36.535941 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.535818    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp" event={"ID":"b3c05bea-e6f1-4bb1-8824-4b31ff448d33","Type":"ContainerDied","Data":"62f1284359bd5a5ba6dbdba4caa0a0173c2ca79b62e1afcd0be6637ab16b7b01"}
Jul 20 16:06:36.547175 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.547155    2569 scope.go:117] "RemoveContainer" containerID="bead074ffb155a76dfba2ca6268daff0f19ad68f9a30032a19c4287b3eb4143d"
Jul 20 16:06:36.554940 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.554919    2569 scope.go:117] "RemoveContainer" containerID="2232092c04eaee80570f4474dfc36f47c0edbeb57f3b127ad1101206bfef43de"
Jul 20 16:06:36.559524 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.559499    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"]
Jul 20 16:06:36.563406 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.563369    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-rrvth"]
Jul 20 16:06:36.564210 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.564191    2569 scope.go:117] "RemoveContainer" containerID="202d2f36bffa6f40add7f384c2f0df7cb1847662f0dd33f7c839b15b78557d7e"
Jul 20 16:06:36.571419 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.571402    2569 scope.go:117] "RemoveContainer" containerID="6ce8d1834c0c77d8c06972b4ed846c7c9b69bda22f93ad658303d72a2a374947"
Jul 20 16:06:36.573803 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.573780    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"]
Jul 20 16:06:36.579408 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.579385    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-vhpvp"]
Jul 20 16:06:36.579814 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.579795    2569 scope.go:117] "RemoveContainer" containerID="d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"
Jul 20 16:06:36.587845 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.587814    2569 scope.go:117] "RemoveContainer" containerID="ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"
Jul 20 16:06:36.595267 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.595244    2569 scope.go:117] "RemoveContainer" containerID="c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"
Jul 20 16:06:36.602826 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.602807    2569 scope.go:117] "RemoveContainer" containerID="f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"
Jul 20 16:06:36.610138 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.610116    2569 scope.go:117] "RemoveContainer" containerID="76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"
Jul 20 16:06:36.617341 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.617322    2569 scope.go:117] "RemoveContainer" containerID="f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"
Jul 20 16:06:36.624634 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.624615    2569 scope.go:117] "RemoveContainer" containerID="d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"
Jul 20 16:06:36.624962 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:06:36.624939    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0\": container with ID starting with d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0 not found: ID does not exist" containerID="d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"
Jul 20 16:06:36.625076 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.624969    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"} err="failed to get container status \"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0\": rpc error: code = NotFound desc = could not find container \"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0\": container with ID starting with d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0 not found: ID does not exist"
Jul 20 16:06:36.625076 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.624989    2569 scope.go:117] "RemoveContainer" containerID="ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"
Jul 20 16:06:36.625252 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:06:36.625235    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad\": container with ID starting with ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad not found: ID does not exist" containerID="ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"
Jul 20 16:06:36.625294 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.625258    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"} err="failed to get container status \"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad\": rpc error: code = NotFound desc = could not find container \"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad\": container with ID starting with ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad not found: ID does not exist"
Jul 20 16:06:36.625294 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.625273    2569 scope.go:117] "RemoveContainer" containerID="c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"
Jul 20 16:06:36.625491 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:06:36.625466    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30\": container with ID starting with c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30 not found: ID does not exist" containerID="c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"
Jul 20 16:06:36.625540 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.625490    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"} err="failed to get container status \"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30\": rpc error: code = NotFound desc = could not find container \"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30\": container with ID starting with c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30 not found: ID does not exist"
Jul 20 16:06:36.625540 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.625508    2569 scope.go:117] "RemoveContainer" containerID="f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"
Jul 20 16:06:36.625768 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:06:36.625752    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b\": container with ID starting with f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b not found: ID does not exist" containerID="f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"
Jul 20 16:06:36.625855 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.625772    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"} err="failed to get container status \"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b\": rpc error: code = NotFound desc = could not find container \"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b\": container with ID starting with f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b not found: ID does not exist"
Jul 20 16:06:36.625855 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.625788    2569 scope.go:117] "RemoveContainer" containerID="76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"
Jul 20 16:06:36.626050 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:06:36.626035    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5\": container with ID starting with 76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5 not found: ID does not exist" containerID="76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"
Jul 20 16:06:36.626099 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626052    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"} err="failed to get container status \"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5\": rpc error: code = NotFound desc = could not find container \"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5\": container with ID starting with 76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5 not found: ID does not exist"
Jul 20 16:06:36.626099 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626064    2569 scope.go:117] "RemoveContainer" containerID="f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"
Jul 20 16:06:36.626308 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:06:36.626292    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681\": container with ID starting with f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681 not found: ID does not exist" containerID="f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"
Jul 20 16:06:36.626348 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626312    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"} err="failed to get container status \"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681\": rpc error: code = NotFound desc = could not find container \"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681\": container with ID starting with f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681 not found: ID does not exist"
Jul 20 16:06:36.626348 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626327    2569 scope.go:117] "RemoveContainer" containerID="d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"
Jul 20 16:06:36.626556 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626539    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0"} err="failed to get container status \"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0\": rpc error: code = NotFound desc = could not find container \"d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0\": container with ID starting with d338ed8a38d57c2cfadb1228025d731823d7f202345ffcad911e9c861a177ac0 not found: ID does not exist"
Jul 20 16:06:36.626600 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626559    2569 scope.go:117] "RemoveContainer" containerID="ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"
Jul 20 16:06:36.626767 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626749    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad"} err="failed to get container status \"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad\": rpc error: code = NotFound desc = could not find container \"ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad\": container with ID starting with ebe082a67e705f7f8abfd71777532eca06806fdb8f510cacc89e7e9d4cc927ad not found: ID does not exist"
Jul 20 16:06:36.626813 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626767    2569 scope.go:117] "RemoveContainer" containerID="c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"
Jul 20 16:06:36.626968 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626953    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30"} err="failed to get container status \"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30\": rpc error: code = NotFound desc = could not find container \"c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30\": container with ID starting with c5cfd74b4ce99524f0bdfc7b314ced365a427baaef6e917bbe62bf636f253c30 not found: ID does not exist"
Jul 20 16:06:36.627008 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.626968    2569 scope.go:117] "RemoveContainer" containerID="f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"
Jul 20 16:06:36.627159 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.627140    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b"} err="failed to get container status \"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b\": rpc error: code = NotFound desc = could not find container \"f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b\": container with ID starting with f4e954ce6e7f48cf27ab4cf45158a6feb2a27765d7d5370221b9f90f99a3848b not found: ID does not exist"
Jul 20 16:06:36.627214 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.627159    2569 scope.go:117] "RemoveContainer" containerID="76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"
Jul 20 16:06:36.627400 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.627381    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5"} err="failed to get container status \"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5\": rpc error: code = NotFound desc = could not find container \"76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5\": container with ID starting with 76191a00914800f810c55a633a3f7e0bd26f0256be0e6a863c83119e681eadc5 not found: ID does not exist"
Jul 20 16:06:36.627454 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.627401    2569 scope.go:117] "RemoveContainer" containerID="f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"
Jul 20 16:06:36.627627 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:36.627612    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681"} err="failed to get container status \"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681\": rpc error: code = NotFound desc = could not find container \"f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681\": container with ID starting with f358faceaac89aa41259fab5993f9aced10fb655251bd42699895f78d2b5d681 not found: ID does not exist"
Jul 20 16:06:37.442191 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:37.442160    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" path="/var/lib/kubelet/pods/5f7c26f3-c7f0-4498-90b2-5d97db28c4c8/volumes"
Jul 20 16:06:37.442706 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:37.442693    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" path="/var/lib/kubelet/pods/b3c05bea-e6f1-4bb1-8824-4b31ff448d33/volumes"
Jul 20 16:06:55.658516 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658481    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mctkk/must-gather-27s7l"]
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658748    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="feast-init"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658759    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="feast-init"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658769    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658776    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658783    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="offline"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658789    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="offline"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658797    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="registry"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658802    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="registry"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658808    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658813    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658822    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="feast-init"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658827    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="feast-init"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658863    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658869    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658882    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="feast-apply"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658887    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="feast-apply"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658894    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="offline"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658899    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="offline"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658905    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658910    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658916    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="feast-apply"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658921    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="feast-apply"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658961    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="ui"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658969    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="offline"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658975    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="online"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658980    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="ui"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658985    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="offline"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658991    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c05bea-e6f1-4bb1-8824-4b31ff448d33" containerName="registry"
Jul 20 16:06:55.659006 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.658997    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7c26f3-c7f0-4498-90b2-5d97db28c4c8" containerName="online"
Jul 20 16:06:55.661760 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.661742    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.663679 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.663654    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mctkk\"/\"default-dockercfg-t95z9\""
Jul 20 16:06:55.664082 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.663659    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mctkk\"/\"kube-root-ca.crt\""
Jul 20 16:06:55.664082 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.663751    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mctkk\"/\"openshift-service-ca.crt\""
Jul 20 16:06:55.669202 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.669176    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mctkk/must-gather-27s7l"]
Jul 20 16:06:55.787085 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.787041    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zhrb\" (UniqueName: \"kubernetes.io/projected/6797517c-38f2-4f40-ac77-b5238105543d-kube-api-access-7zhrb\") pod \"must-gather-27s7l\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") " pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.787085 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.787091    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6797517c-38f2-4f40-ac77-b5238105543d-must-gather-output\") pod \"must-gather-27s7l\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") " pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.887718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.887677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zhrb\" (UniqueName: \"kubernetes.io/projected/6797517c-38f2-4f40-ac77-b5238105543d-kube-api-access-7zhrb\") pod \"must-gather-27s7l\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") " pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.887718 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.887716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6797517c-38f2-4f40-ac77-b5238105543d-must-gather-output\") pod \"must-gather-27s7l\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") " pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.888111 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.888091    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6797517c-38f2-4f40-ac77-b5238105543d-must-gather-output\") pod \"must-gather-27s7l\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") " pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.896125 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.896098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zhrb\" (UniqueName: \"kubernetes.io/projected/6797517c-38f2-4f40-ac77-b5238105543d-kube-api-access-7zhrb\") pod \"must-gather-27s7l\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") " pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:55.983238 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:55.983141    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:06:56.114619 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:56.114575    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mctkk/must-gather-27s7l"]
Jul 20 16:06:56.118498 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:06:56.118469    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6797517c_38f2_4f40_ac77_b5238105543d.slice/crio-5fb51eabb324c561c9d03818f5b1cb55d96a1e41708baa1033af8dfee4b74bc0 WatchSource:0}: Error finding container 5fb51eabb324c561c9d03818f5b1cb55d96a1e41708baa1033af8dfee4b74bc0: Status 404 returned error can't find the container with id 5fb51eabb324c561c9d03818f5b1cb55d96a1e41708baa1033af8dfee4b74bc0
Jul 20 16:06:56.120219 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:56.120200    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 16:06:56.612678 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:06:56.612640    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctkk/must-gather-27s7l" event={"ID":"6797517c-38f2-4f40-ac77-b5238105543d","Type":"ContainerStarted","Data":"5fb51eabb324c561c9d03818f5b1cb55d96a1e41708baa1033af8dfee4b74bc0"}
Jul 20 16:07:02.642085 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:02.641986    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctkk/must-gather-27s7l" event={"ID":"6797517c-38f2-4f40-ac77-b5238105543d","Type":"ContainerStarted","Data":"20c69c98f3be18098d937f46b07a4650fa7da0078576a6ef7ac6442d146ace46"}
Jul 20 16:07:02.642085 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:02.642039    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctkk/must-gather-27s7l" event={"ID":"6797517c-38f2-4f40-ac77-b5238105543d","Type":"ContainerStarted","Data":"ca860ec5235157618651580fefe5a7487f46ee92416629f7753d9b40425f2f5a"}
Jul 20 16:07:02.658665 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:02.658599    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mctkk/must-gather-27s7l" podStartSLOduration=1.505273415 podStartE2EDuration="7.658574469s" totalImagesPullingTime="6.153301054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:07:02.657310729 +0000 UTC m=+1735.772160815" watchObservedRunningTime="2026-07-20 16:07:02.658574469 +0000 UTC m=+1735.773424556"
Jul 20 16:07:12.681656 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:12.681620    2569 generic.go:356] "Generic (PLEG): container finished" podID="6797517c-38f2-4f40-ac77-b5238105543d" containerID="ca860ec5235157618651580fefe5a7487f46ee92416629f7753d9b40425f2f5a" exitCode=0
Jul 20 16:07:12.682126 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:12.681679    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mctkk/must-gather-27s7l" event={"ID":"6797517c-38f2-4f40-ac77-b5238105543d","Type":"ContainerDied","Data":"ca860ec5235157618651580fefe5a7487f46ee92416629f7753d9b40425f2f5a"}
Jul 20 16:07:12.682126 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:12.681982    2569 scope.go:117] "RemoveContainer" containerID="ca860ec5235157618651580fefe5a7487f46ee92416629f7753d9b40425f2f5a"
Jul 20 16:07:13.192848 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.192803    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctkk_must-gather-27s7l_6797517c-38f2-4f40-ac77-b5238105543d/gather/0.log"
Jul 20 16:07:13.704513 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.704470    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-62kzk/must-gather-dnbfd"]
Jul 20 16:07:13.706993 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.706965    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:13.708986 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.708963    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-62kzk\"/\"default-dockercfg-lvqfw\""
Jul 20 16:07:13.709119 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.708966    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-62kzk\"/\"kube-root-ca.crt\""
Jul 20 16:07:13.709422 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.709408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-62kzk\"/\"openshift-service-ca.crt\""
Jul 20 16:07:13.716090 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.716066    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-62kzk/must-gather-dnbfd"]
Jul 20 16:07:13.720344 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.720320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6848ac3e-654c-415b-8ec5-0b6a75975a09-must-gather-output\") pod \"must-gather-dnbfd\" (UID: \"6848ac3e-654c-415b-8ec5-0b6a75975a09\") " pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:13.720449 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.720359    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbz9h\" (UniqueName: \"kubernetes.io/projected/6848ac3e-654c-415b-8ec5-0b6a75975a09-kube-api-access-vbz9h\") pod \"must-gather-dnbfd\" (UID: \"6848ac3e-654c-415b-8ec5-0b6a75975a09\") " pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:13.820857 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.820792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6848ac3e-654c-415b-8ec5-0b6a75975a09-must-gather-output\") pod \"must-gather-dnbfd\" (UID: \"6848ac3e-654c-415b-8ec5-0b6a75975a09\") " pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:13.821036 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.820965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbz9h\" (UniqueName: \"kubernetes.io/projected/6848ac3e-654c-415b-8ec5-0b6a75975a09-kube-api-access-vbz9h\") pod \"must-gather-dnbfd\" (UID: \"6848ac3e-654c-415b-8ec5-0b6a75975a09\") " pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:13.821167 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.821151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6848ac3e-654c-415b-8ec5-0b6a75975a09-must-gather-output\") pod \"must-gather-dnbfd\" (UID: \"6848ac3e-654c-415b-8ec5-0b6a75975a09\") " pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:13.829749 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:13.829718    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbz9h\" (UniqueName: \"kubernetes.io/projected/6848ac3e-654c-415b-8ec5-0b6a75975a09-kube-api-access-vbz9h\") pod \"must-gather-dnbfd\" (UID: \"6848ac3e-654c-415b-8ec5-0b6a75975a09\") " pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:14.016448 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:14.016415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-62kzk/must-gather-dnbfd"
Jul 20 16:07:14.148909 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:14.148875    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-62kzk/must-gather-dnbfd"]
Jul 20 16:07:14.151534 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:07:14.151506    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6848ac3e_654c_415b_8ec5_0b6a75975a09.slice/crio-d035ccdbf253dc7bfe80139dd9da1fb09ffdddf3fc811114302bde9e9b7ef400 WatchSource:0}: Error finding container d035ccdbf253dc7bfe80139dd9da1fb09ffdddf3fc811114302bde9e9b7ef400: Status 404 returned error can't find the container with id d035ccdbf253dc7bfe80139dd9da1fb09ffdddf3fc811114302bde9e9b7ef400
Jul 20 16:07:14.690081 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:14.690043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62kzk/must-gather-dnbfd" event={"ID":"6848ac3e-654c-415b-8ec5-0b6a75975a09","Type":"ContainerStarted","Data":"d035ccdbf253dc7bfe80139dd9da1fb09ffdddf3fc811114302bde9e9b7ef400"}
Jul 20 16:07:15.696441 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:15.696402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62kzk/must-gather-dnbfd" event={"ID":"6848ac3e-654c-415b-8ec5-0b6a75975a09","Type":"ContainerStarted","Data":"969cc35201ae5efae381c98cb06f6ab3e55115db8c8e502078324c38f4241fdd"}
Jul 20 16:07:15.696929 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:15.696456    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62kzk/must-gather-dnbfd" event={"ID":"6848ac3e-654c-415b-8ec5-0b6a75975a09","Type":"ContainerStarted","Data":"634a9c8152d762cf40ea4b205ab127b016e39f261bcd283229245602f544130d"}
Jul 20 16:07:15.714341 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:15.714272    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-62kzk/must-gather-dnbfd" podStartSLOduration=1.959474231 podStartE2EDuration="2.714248622s" totalImagesPullingTime="754.774391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 16:07:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:07:15.714065147 +0000 UTC m=+1748.828915256" watchObservedRunningTime="2026-07-20 16:07:15.714248622 +0000 UTC m=+1748.829098707"
Jul 20 16:07:16.383942 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:16.383910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rflsh_04b04807-15ac-4c14-996b-fc7456ca4621/global-pull-secret-syncer/0.log"
Jul 20 16:07:16.499755 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:16.499727    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sm6jv_c54da2ef-e717-478f-95b0-b57b158b8593/konnectivity-agent/0.log"
Jul 20 16:07:16.578060 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:16.578015    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-8.ec2.internal_b30696e4d4a2a43878c66454fe445b18/haproxy/0.log"
Jul 20 16:07:18.529801 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.529757    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-mctkk/must-gather-27s7l"]
Jul 20 16:07:18.530390 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.530024    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-mctkk/must-gather-27s7l" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="copy" containerID="cri-o://20c69c98f3be18098d937f46b07a4650fa7da0078576a6ef7ac6442d146ace46" gracePeriod=2
Jul 20 16:07:18.534472 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.534439    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-mctkk/must-gather-27s7l"]
Jul 20 16:07:18.725635 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.725592    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctkk_must-gather-27s7l_6797517c-38f2-4f40-ac77-b5238105543d/copy/0.log"
Jul 20 16:07:18.726385 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.726340    2569 generic.go:356] "Generic (PLEG): container finished" podID="6797517c-38f2-4f40-ac77-b5238105543d" containerID="20c69c98f3be18098d937f46b07a4650fa7da0078576a6ef7ac6442d146ace46" exitCode=143
Jul 20 16:07:18.940034 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.940002    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctkk_must-gather-27s7l_6797517c-38f2-4f40-ac77-b5238105543d/copy/0.log"
Jul 20 16:07:18.943237 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.942861    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:07:18.945673 ip-10-0-141-8 kubenswrapper[2569]: E0720 16:07:18.945626    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-27s7l\" is forbidden: User \"system:node:ip-10-0-141-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-mctkk\": no relationship found between node 'ip-10-0-141-8.ec2.internal' and this object" podUID="6797517c-38f2-4f40-ac77-b5238105543d" pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:07:18.977768 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.977112    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6797517c-38f2-4f40-ac77-b5238105543d-must-gather-output\") pod \"6797517c-38f2-4f40-ac77-b5238105543d\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") "
Jul 20 16:07:18.977768 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.977210    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zhrb\" (UniqueName: \"kubernetes.io/projected/6797517c-38f2-4f40-ac77-b5238105543d-kube-api-access-7zhrb\") pod \"6797517c-38f2-4f40-ac77-b5238105543d\" (UID: \"6797517c-38f2-4f40-ac77-b5238105543d\") "
Jul 20 16:07:18.978419 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.978387    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6797517c-38f2-4f40-ac77-b5238105543d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "6797517c-38f2-4f40-ac77-b5238105543d" (UID: "6797517c-38f2-4f40-ac77-b5238105543d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 16:07:18.982211 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:18.982166    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6797517c-38f2-4f40-ac77-b5238105543d-kube-api-access-7zhrb" (OuterVolumeSpecName: "kube-api-access-7zhrb") pod "6797517c-38f2-4f40-ac77-b5238105543d" (UID: "6797517c-38f2-4f40-ac77-b5238105543d"). InnerVolumeSpecName "kube-api-access-7zhrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 16:07:19.078880 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.078736    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zhrb\" (UniqueName: \"kubernetes.io/projected/6797517c-38f2-4f40-ac77-b5238105543d-kube-api-access-7zhrb\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:07:19.078880 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.078777    2569 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6797517c-38f2-4f40-ac77-b5238105543d-must-gather-output\") on node \"ip-10-0-141-8.ec2.internal\" DevicePath \"\""
Jul 20 16:07:19.445008 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.444923    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6797517c-38f2-4f40-ac77-b5238105543d" path="/var/lib/kubelet/pods/6797517c-38f2-4f40-ac77-b5238105543d/volumes"
Jul 20 16:07:19.735047 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.734958    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-mctkk_must-gather-27s7l_6797517c-38f2-4f40-ac77-b5238105543d/copy/0.log"
Jul 20 16:07:19.735511 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.735498    2569 scope.go:117] "RemoveContainer" containerID="20c69c98f3be18098d937f46b07a4650fa7da0078576a6ef7ac6442d146ace46"
Jul 20 16:07:19.735682 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.735661    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mctkk/must-gather-27s7l"
Jul 20 16:07:19.749484 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:19.749418    2569 scope.go:117] "RemoveContainer" containerID="ca860ec5235157618651580fefe5a7487f46ee92416629f7753d9b40425f2f5a"
Jul 20 16:07:20.433534 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.433508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/alertmanager/0.log"
Jul 20 16:07:20.463892 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.463866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/config-reloader/0.log"
Jul 20 16:07:20.493039 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.492990    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/kube-rbac-proxy-web/0.log"
Jul 20 16:07:20.526494 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.526457    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/kube-rbac-proxy/0.log"
Jul 20 16:07:20.558147 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.558120    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/kube-rbac-proxy-metric/0.log"
Jul 20 16:07:20.591537 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.591505    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/prom-label-proxy/0.log"
Jul 20 16:07:20.626031 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.626003    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_189027c4-b504-4bea-acdb-2a43e0bafa9d/init-config-reloader/0.log"
Jul 20 16:07:20.807105 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:20.807080    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7f458df58f-59jvp_8324d88d-565b-4f2b-a228-ae1a5f9e5b03/metrics-server/0.log"
Jul 20 16:07:21.004130 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.004092    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nhvh8_fc420100-b9ba-4bac-b742-389a214ed786/node-exporter/0.log"
Jul 20 16:07:21.036617 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.036591    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nhvh8_fc420100-b9ba-4bac-b742-389a214ed786/kube-rbac-proxy/0.log"
Jul 20 16:07:21.065930 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.065824    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nhvh8_fc420100-b9ba-4bac-b742-389a214ed786/init-textfile/0.log"
Jul 20 16:07:21.201711 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.201677    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-d85rf_27f7d23e-29da-433b-9372-59ebec564723/kube-rbac-proxy-main/0.log"
Jul 20 16:07:21.235318 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.235288    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-d85rf_27f7d23e-29da-433b-9372-59ebec564723/kube-rbac-proxy-self/0.log"
Jul 20 16:07:21.271391 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.271355    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-d85rf_27f7d23e-29da-433b-9372-59ebec564723/openshift-state-metrics/0.log"
Jul 20 16:07:21.670311 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.670284    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c5744fb89-kscr6_29bb47b8-1117-4109-888e-391efea5a902/telemeter-client/0.log"
Jul 20 16:07:21.706446 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.706420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c5744fb89-kscr6_29bb47b8-1117-4109-888e-391efea5a902/reload/0.log"
Jul 20 16:07:21.738012 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:21.737963    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c5744fb89-kscr6_29bb47b8-1117-4109-888e-391efea5a902/kube-rbac-proxy/0.log"
Jul 20 16:07:23.666027 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.665987    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"]
Jul 20 16:07:23.666626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.666417    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="gather"
Jul 20 16:07:23.666626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.666436    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="gather"
Jul 20 16:07:23.666626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.666451    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="copy"
Jul 20 16:07:23.666626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.666459    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="copy"
Jul 20 16:07:23.666626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.666550    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="copy"
Jul 20 16:07:23.666626 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.666565    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6797517c-38f2-4f40-ac77-b5238105543d" containerName="gather"
Jul 20 16:07:23.670106 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.670076    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.679703 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.679676    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"]
Jul 20 16:07:23.722617 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.722575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvv4v\" (UniqueName: \"kubernetes.io/projected/4ea93b71-fef3-4013-b316-f45af777da9a-kube-api-access-zvv4v\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.722814 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.722633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-podres\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.722814 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.722663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-sys\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.722814 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.722725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-lib-modules\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.722814 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.722769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-proc\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823397 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-lib-modules\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-proc\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvv4v\" (UniqueName: \"kubernetes.io/projected/4ea93b71-fef3-4013-b316-f45af777da9a-kube-api-access-zvv4v\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823489    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-podres\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-sys\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823529    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-proc\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823580 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-lib-modules\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823895 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823648    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-sys\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.823895 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.823683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4ea93b71-fef3-4013-b316-f45af777da9a-podres\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.832133 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.832100    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvv4v\" (UniqueName: \"kubernetes.io/projected/4ea93b71-fef3-4013-b316-f45af777da9a-kube-api-access-zvv4v\") pod \"perf-node-gather-daemonset-m8kkd\" (UID: \"4ea93b71-fef3-4013-b316-f45af777da9a\") " pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:23.982702 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:23.982610    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:24.012632 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.012584    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85b77f597-7grkf_078841f8-3de9-4f5a-bf9e-58eea2e73eb6/console/0.log"
Jul 20 16:07:24.054350 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.054218    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-q6k2x_fb2f7272-19cb-40a0-9cc5-da9fa6a35af0/download-server/0.log"
Jul 20 16:07:24.138537 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.138450    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"]
Jul 20 16:07:24.143953 ip-10-0-141-8 kubenswrapper[2569]: W0720 16:07:24.142351    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4ea93b71_fef3_4013_b316_f45af777da9a.slice/crio-f464e30248cf0b065a7d1560a784e5873bf783145835ae00a2504d07b2ad6c7d WatchSource:0}: Error finding container f464e30248cf0b065a7d1560a784e5873bf783145835ae00a2504d07b2ad6c7d: Status 404 returned error can't find the container with id f464e30248cf0b065a7d1560a784e5873bf783145835ae00a2504d07b2ad6c7d
Jul 20 16:07:24.761609 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.761575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd" event={"ID":"4ea93b71-fef3-4013-b316-f45af777da9a","Type":"ContainerStarted","Data":"81fe88f1a25ca5cb81be37d606843abe297bc95701d8c586da08224a4c19bd81"}
Jul 20 16:07:24.762023 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.761624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd" event={"ID":"4ea93b71-fef3-4013-b316-f45af777da9a","Type":"ContainerStarted","Data":"f464e30248cf0b065a7d1560a784e5873bf783145835ae00a2504d07b2ad6c7d"}
Jul 20 16:07:24.762023 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.761677    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:24.778070 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:24.778018    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd" podStartSLOduration=1.777998584 podStartE2EDuration="1.777998584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 16:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 16:07:24.7766372 +0000 UTC m=+1757.891487286" watchObservedRunningTime="2026-07-20 16:07:24.777998584 +0000 UTC m=+1757.892848690"
Jul 20 16:07:25.535061 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:25.535012    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vcqv_8872159f-72c6-44e9-9c76-50488fcbeb3e/dns/0.log"
Jul 20 16:07:25.561080 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:25.561052    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vcqv_8872159f-72c6-44e9-9c76-50488fcbeb3e/kube-rbac-proxy/0.log"
Jul 20 16:07:25.639642 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:25.639611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p8zm2_6d4fff96-98b6-443e-a673-968187ab8f33/dns-node-resolver/0.log"
Jul 20 16:07:26.289485 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:26.289458    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-852hk_c4abe2d1-0e5e-4056-a43f-9aeef59ad0c7/node-ca/0.log"
Jul 20 16:07:27.563738 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:27.563695    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lksdr_0ae2a2c0-53df-4000-b770-5292e22a24e7/serve-healthcheck-canary/0.log"
Jul 20 16:07:28.112451 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:28.112421    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79wps_f749663d-097d-4f09-89e3-3ad02eb02f6d/kube-rbac-proxy/0.log"
Jul 20 16:07:28.138843 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:28.138798    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79wps_f749663d-097d-4f09-89e3-3ad02eb02f6d/exporter/0.log"
Jul 20 16:07:28.165850 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:28.165800    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-79wps_f749663d-097d-4f09-89e3-3ad02eb02f6d/extractor/0.log"
Jul 20 16:07:30.777033 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:30.777006    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-62kzk/perf-node-gather-daemonset-m8kkd"
Jul 20 16:07:34.188367 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.188238    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2x69d_6e8af669-dcfb-45e1-a68b-1cf064190c96/kube-multus/0.log"
Jul 20 16:07:34.420720 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.420692    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/kube-multus-additional-cni-plugins/0.log"
Jul 20 16:07:34.445969 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.445827    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/egress-router-binary-copy/0.log"
Jul 20 16:07:34.469705 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.469681    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/cni-plugins/0.log"
Jul 20 16:07:34.496673 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.496644    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/bond-cni-plugin/0.log"
Jul 20 16:07:34.521446 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.521418    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/routeoverride-cni/0.log"
Jul 20 16:07:34.547151 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.547122    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/whereabouts-cni-bincopy/0.log"
Jul 20 16:07:34.573031 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.573006    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7nz4v_c630dde8-7dd2-4f55-afa4-e9e50aff5624/whereabouts-cni/0.log"
Jul 20 16:07:34.809228 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.809190    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bkt82_3ee2ac86-e86d-4ff0-9a76-24773f962f61/network-metrics-daemon/0.log"
Jul 20 16:07:34.830794 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:34.830760    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bkt82_3ee2ac86-e86d-4ff0-9a76-24773f962f61/kube-rbac-proxy/0.log"
Jul 20 16:07:36.166232 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.166202    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/ovn-controller/0.log"
Jul 20 16:07:36.187999 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.187977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/ovn-acl-logging/0.log"
Jul 20 16:07:36.214088 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.214053    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/kube-rbac-proxy-node/0.log"
Jul 20 16:07:36.239735 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.239706    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/kube-rbac-proxy-ovn-metrics/0.log"
Jul 20 16:07:36.277321 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.277290    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/northd/0.log"
Jul 20 16:07:36.305619 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.305596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/nbdb/0.log"
Jul 20 16:07:36.331465 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.331436    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/sbdb/0.log"
Jul 20 16:07:36.392033 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:36.391993    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ztv8w_0f829165-20e8-4f2b-b5d5-c01150e0c959/ovnkube-controller/0.log"
Jul 20 16:07:37.457303 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:37.457271    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-424gk_54319d6a-7d6d-4678-994b-bd4566eb35db/network-check-target-container/0.log"
Jul 20 16:07:38.513880 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:38.513851    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-svfdf_699f20a3-4268-4a76-8547-9bca5ff9b9e6/iptables-alerter/0.log"
Jul 20 16:07:39.315094 ip-10-0-141-8 kubenswrapper[2569]: I0720 16:07:39.315061    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-jkcsr_45eb1a3c-ce14-4b93-96d3-77ee176b3614/tuned/0.log"