Sep 08 11:34:05.517715 ip-10-0-143-186 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 11:34:05.901406 ip-10-0-143-186 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 11:34:05.901406 ip-10-0-143-186 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 11:34:05.901406 ip-10-0-143-186 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 11:34:05.901406 ip-10-0-143-186 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 11:34:05.901406 ip-10-0-143-186 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 11:34:05.903223 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.903133    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 11:34:05.906276 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906260    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:34:05.906276 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906276    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906280    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906283    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906286    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906289    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906292    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906300    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906302    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906305    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906308    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906310    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906313    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906315    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906318    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906321    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906323    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906326    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906329    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906331    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906334    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:34:05.906341 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906336    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906339    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906342    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906346    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906349    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906352    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906355    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906358    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906361    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906364    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906366    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906369    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906371    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906374    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906376    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906379    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906381    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906384    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906387    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:34:05.906833 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906390    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906392    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906395    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906397    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906400    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906402    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906405    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906407    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906411    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906414    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906417    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906420    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906437    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906441    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906446    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906451    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906455    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906459    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906462    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:34:05.907286 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906465    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906468    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906471    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906474    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906477    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906479    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906482    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906486    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906490    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906492    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906495    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906498    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906501    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906504    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906507    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906510    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906513    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906515    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906518    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906521    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:34:05.907776 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906523    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906526    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906529    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906531    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906534    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906538    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906541    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906544    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906547    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906550    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906552    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906555    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906557    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906560    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906563    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906566    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906568    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906571    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906574    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.906577    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:34:05.908304 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907283    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907290    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907293    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907296    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907299    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907301    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907304    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907307    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907310    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907313    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907316    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907319    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907322    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907324    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907327    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907332    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907336    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907339    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907342    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:34:05.908804 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907344    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907349    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907353    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907356    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907359    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907362    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907365    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907368    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907371    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907373    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907376    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907380    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907384    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907387    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907390    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907393    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907396    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907398    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907401    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:34:05.909281 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907404    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907406    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907410    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907412    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907415    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907418    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907420    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907439    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907443    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907446    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907449    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907452    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907454    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907457    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907461    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907464    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907467    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907470    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907472    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907475    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:34:05.909757 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907478    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907480    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907483    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907486    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907489    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907491    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907494    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907496    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907499    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907502    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907504    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907506    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907509    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907512    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907514    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907517    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907520    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907523    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907525    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907528    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:34:05.910247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907531    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907533    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907536    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907540    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907542    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907545    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907548    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907551    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907554    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907556    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907559    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907561    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907564    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907566    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907569    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907571    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907574    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907577    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907579    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907582    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:34:05.910753 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907585    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.907998    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908005    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908008    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908011    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908014    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908017    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908020    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908023    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908025    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908028    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908031    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908033    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908036    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908039    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908042    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908045    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908047    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908050    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:34:05.911247 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908053    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908055    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908058    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908060    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908063    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908065    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908068    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908070    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908073    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908076    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908078    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908081    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908083    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908086    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908088    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908091    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908093    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908096    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908099    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908101    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:34:05.911728 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908104    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908107    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908110    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908112    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908115    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908118    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908120    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908123    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908125    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908128    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908130    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908133    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908136    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908140    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908143    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908146    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908149    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908152    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908156    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908158    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:34:05.912217 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908161    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908164    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908166    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908169    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908171    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908174    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908177    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908180    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908182    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908185    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908187    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908190    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908192    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908197    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908203    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908207    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908210    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908213    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908215    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:34:05.912805 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908218    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908221    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908223    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908226    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908229    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908231    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908234    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908237    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908240    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908242    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908245    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908248    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908251    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908254    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908257    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908259    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908262    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908265    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908267    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908270    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:34:05.913311 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908272    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.908275    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908350    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908383    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908390    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908394    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908400    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908403    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908408    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908416    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908420    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908436    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908440    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908443    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908446    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908449    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908454    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908457    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908460    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908463    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908467    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908470    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908473    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908476    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 11:34:05.913812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908480    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908483    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908486    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908489    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908493    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908496    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908499    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908501    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908504    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908507    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908511    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908515    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908517    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908521    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908524    2577 flags.go:64] FLAG: --enable-server="true"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908527    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908531    2577 flags.go:64] FLAG: --event-burst="100"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908535    2577 flags.go:64] FLAG: --event-qps="50"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908538    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908541    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908544    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908548    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908551    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908554    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908558    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 08 11:34:05.914379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908561    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908564    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908567    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908570    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908573    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908576    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908579    2577 flags.go:64] FLAG: --feature-gates=""
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908583    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908586    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908589    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908592    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908595    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908598    2577 flags.go:64] FLAG: --help="false"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908601    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-143-186.ec2.internal"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908604    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908607    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908610    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908614    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908617    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908620    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908623    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908626    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908629    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 11:34:05.914974 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908632    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908635    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908639    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908642    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908644    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908648    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908651    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908654    2577 flags.go:64] FLAG: --lock-file=""
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908658    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908661    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908664    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908669    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908672    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908675    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908678    2577 flags.go:64] FLAG: --logging-format="text"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908681    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908685    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908688    2577 flags.go:64] FLAG: --manifest-url=""
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908690    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908694    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908697    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908702    2577 flags.go:64] FLAG: --max-pods="110"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908705    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908708    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908711    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 11:34:05.915673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908714    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908717    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908721    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908723    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908731    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908734    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908737    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908740    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908743    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908748    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908751    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908754    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908757    2577 flags.go:64] FLAG: --port="10250"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908760    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908763    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a92e77f4ebcb303"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908768    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908771    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908773    2577 flags.go:64] FLAG: --register-node="true"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908776    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908780    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908783    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908785    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908788    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908792    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908795    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 11:34:05.916626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908798    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908801    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908804    2577 flags.go:64] FLAG: --runonce="false"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908807    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908811    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908814    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908817    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908820    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908823    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908826    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908830    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908833    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908836    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908839    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908842    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908845    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908848    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908851    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908860    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908863    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908866    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908870    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908874    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908877    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908880    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 11:34:05.917304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908883    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908886    2577 flags.go:64] FLAG: --v="2"
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908890    2577 flags.go:64] FLAG: --version="false"
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908894    2577 flags.go:64] FLAG: --vmodule=""
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908898    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.908901    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909036    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909040    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909044    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909046    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909049    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909052    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909055    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909057    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909060    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909064    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909067    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909073    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909076    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909079    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:34:05.917944 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909082    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909084    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909087    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909089    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909092    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909095    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909097    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909101    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909103    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909108    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909111    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909113    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909116    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909118    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909121    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909124    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909126    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909131    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909134    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:34:05.918445 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909137    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909140    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909142    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909145    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909147    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909150    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909153    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909155    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909158    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909160    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909164    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909167    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909169    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909172    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909175    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909178    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909180    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909182    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909185    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909187    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:34:05.918915 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909190    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909193    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909196    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909199    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909202    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909204    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909207    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909209    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909212    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909214    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909217    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909219    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909222    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909224    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909227    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909229    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909232    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909234    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909237    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909239    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909242    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:34:05.919416 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909245    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909249    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909251    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909254    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909257    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909260    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909264    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909267    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909270    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909273    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909276    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909279    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909282    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909287    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909290    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909292    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909295    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909298    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909300    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:34:05.919949 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909303    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909306    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909308    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909311    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909314    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.909316    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.909949    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.918227    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.918242    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.918259    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.918265    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918320    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918325    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918328    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:34:05.920459 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918332    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918335    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918338    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918341    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918344    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918347    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918350    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918352    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918356    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918359    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918361    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918364    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918366    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918369    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918371    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918374    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918377    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918379    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918382    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918384    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918387    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:34:05.920815 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918390    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918392    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918395    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918398    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918400    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918404    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918407    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918410    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918412    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918415    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918417    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918420    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918438    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918442    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918444    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918447    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918450    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918453    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918455    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918459    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:34:05.921320 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918463    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918467    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918471    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918474    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918477    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918479    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918482    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918485    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918487    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918490    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918492    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918511    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918515    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918518    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918521    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918524    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918527    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918530    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918533    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:34:05.921880 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918536    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918539    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918542    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918546    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918549    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918553    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918555    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918558    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918560    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918563    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918565    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918568    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918572    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918575    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918578    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918581    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918584    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918587    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918589    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:34:05.922358 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918592    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918595    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918598    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918601    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918603    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918606    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918608    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918611    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918614    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918616    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918619    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918622    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918625    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918627    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918630    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918633    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:34:05.922839 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918635    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.918640    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918749    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918755    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918758    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918762    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918765    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918768    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918771    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918773    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918776    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918779    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918782    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918785    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918788    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 11:34:05.923223 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918790    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918793    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918796    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918798    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918801    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918803    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918806    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918808    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918811    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918813    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918816    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918818    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918821    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918824    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918826    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918829    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918832    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918835    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918837    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918840    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 11:34:05.923600 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918843    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918845    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918848    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918850    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918853    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918855    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918858    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918860    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918863    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918865    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918868    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918870    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918873    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918877    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918881    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918883    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918886    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918889    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918891    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 11:34:05.924087 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918894    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918896    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918898    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918901    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918904    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918906    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918909    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918911    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918914    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918916    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918919    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918922    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918924    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918927    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918930    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918933    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918935    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918938    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918940    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918943    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 11:34:05.924616 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918946    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918948    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918951    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918953    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918956    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918958    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918962    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918964    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918967    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918969    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918972    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918974    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918977    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918981    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918984    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918988    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918991    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918994    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.918997    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 11:34:05.925092 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919000    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919002    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919005    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919007    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919010    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919013    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919015    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:05.919018    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.919022    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.919120    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.921754    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.922622    2577 server.go:1019] "Starting client certificate rotation"
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.922713    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 11:34:05.925573 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.922751    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 11:34:05.925934 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.925301    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 11:34:05.928901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.928885    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 11:34:05.942911 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.942892    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 08 11:34:05.948909 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.948892    2577 log.go:25] "Validated CRI v1 image API"
Sep 08 11:34:05.949823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.949805    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 11:34:05.952812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.952791    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af050fd1-11c6-4d74-b084-1709724389f5:/dev/nvme0n1p3 fe41803d-c62e-4ebd-b8c6-79c64ef6071e:/dev/nvme0n1p4]
Sep 08 11:34:05.952888 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.952811    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 11:34:05.956580 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.956563    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 11:34:05.958679 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.958573    2577 manager.go:216] Machine: {Timestamp:2026-09-08 11:34:05.957248978 +0000 UTC m=+0.328179468 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098566 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2003ebe2e93b72741020d8ff8e0f92 SystemUUID:ec2003eb-e2e9-3b72-7410-20d8ff8e0f92 BootID:6db3a18f-62ce-4822-97e7-e61aad2fa850 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:e4:3d:24:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:e4:3d:24:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:e6:d9:2d:b9:17 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 11:34:05.958679 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.958675    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 11:34:05.958787 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.958756    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 11:34:05.961597 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.961568    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 11:34:05.961737 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.961600    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-186.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 11:34:05.962321 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.962311    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 11:34:05.962351 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.962323    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 11:34:05.962351 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.962332    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 11:34:05.962958 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.962947    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 11:34:05.963786 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.963775    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 11:34:05.968406 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968394    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 11:34:05.968534 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968524    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 11:34:05.968570 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968558    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 11:34:05.968570 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968567    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 11:34:05.968624 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968580    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 11:34:05.968624 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968590    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 08 11:34:05.968624 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968599    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 11:34:05.968989 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968975    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 11:34:05.969050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.968997    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 11:34:05.971169 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.971152    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 11:34:05.973363 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.973346    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 11:34:05.973467 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.973385    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 11:34:05.975100 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975086    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 11:34:05.975172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975108    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 11:34:05.975172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975117    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 11:34:05.975172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975125    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 11:34:05.975172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975137    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 11:34:05.975172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975146    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 11:34:05.975172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975168    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 11:34:05.975375 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975176    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 11:34:05.975375 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975188    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 11:34:05.975375 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975197    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 11:34:05.975375 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975221    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 11:34:05.975375 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975230    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 11:34:05.976002 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.975990    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 11:34:05.976051 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.976004    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 11:34:05.979458 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.979420    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-186.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 11:34:05.979548 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.979514    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 11:34:05.979548 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.979516    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 11:34:05.979803 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.979791    2577 server.go:1268] "Started kubelet"
Sep 08 11:34:05.979893 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.979865    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 11:34:05.980028 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.979962    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 11:34:05.980098 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.980054    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 11:34:05.980729 ip-10-0-143-186 systemd[1]: Started Kubernetes Kubelet.
Sep 08 11:34:05.981581 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.981562    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 11:34:05.982345 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.982334    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 11:34:05.985961 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.985940    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 11:34:05.986498 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.986476    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 11:34:05.986788 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.986690    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:05.987304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.987169    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 11:34:05.987304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.987195    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 11:34:05.987304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.987205    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 11:34:05.987494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.987388    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 11:34:05.987494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.987395    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 11:34:05.990227 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.990206    2577 factory.go:55] Registering systemd factory
Sep 08 11:34:05.990353 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.990342    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 08 11:34:05.990490 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.988139    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-186.ec2.internal.18d355484af486d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-186.ec2.internal,UID:ip-10-0-143-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-186.ec2.internal,},FirstTimestamp:2026-09-08 11:34:05.979764437 +0000 UTC m=+0.350694926,LastTimestamp:2026-09-08 11:34:05.979764437 +0000 UTC m=+0.350694926,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-186.ec2.internal,}"
Sep 08 11:34:05.991138 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.991120    2577 factory.go:153] Registering CRI-O factory
Sep 08 11:34:05.991219 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.991142    2577 factory.go:223] Registration of the crio container factory successfully
Sep 08 11:34:05.991270 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.991243    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 11:34:05.991318 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.991313    2577 factory.go:103] Registering Raw factory
Sep 08 11:34:05.991364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.991331    2577 manager.go:1196] Started watching for new ooms in manager
Sep 08 11:34:05.991456 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.991420    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 11:34:05.992041 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:05.992025    2577 manager.go:349] Starting recovery of all containers
Sep 08 11:34:05.994256 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.994231    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 11:34:05.994354 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:05.994296    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-186.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 11:34:06.005808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.005789    2577 manager.go:354] Recovery completed
Sep 08 11:34:06.009367 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.009347    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fzv5k"
Sep 08 11:34:06.010196 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.010185    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.013089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013071    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.013168 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013110    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.013168 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013126    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.013762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013747    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 11:34:06.013762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013757    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.013762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013761    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 11:34:06.013938 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.013780    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 11:34:06.014517 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.014500    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.014598 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.014526    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.014598 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.014542    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.014974 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.014905    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-186.ec2.internal.18d355484cf0fd35  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-186.ec2.internal,UID:ip-10-0-143-186.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-186.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-186.ec2.internal,},FirstTimestamp:2026-09-08 11:34:06.013087029 +0000 UTC m=+0.384017518,LastTimestamp:2026-09-08 11:34:06.013087029 +0000 UTC m=+0.384017518,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-186.ec2.internal,}"
Sep 08 11:34:06.016000 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.015987    2577 policy_none.go:49] "None policy: Start"
Sep 08 11:34:06.016055 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.016004    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 11:34:06.016055 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.016015    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 11:34:06.018138 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.018039    2577 policy_none.go:47] "Start"
Sep 08 11:34:06.018309 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.018293    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fzv5k"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.056949    2577 manager.go:337] "Starting Device Plugin manager"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.056982    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.056991    2577 server.go:87] "Starting device plugin registration server"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.057210    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.057219    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.057323    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.057403    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.057411    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.057886    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 11:34:06.065963 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.057935    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:06.120954 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.120925    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 11:34:06.122122 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.122103    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 11:34:06.122182 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.122165    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 11:34:06.122228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.122193    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 11:34:06.122308 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.122293    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 11:34:06.125167 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.125148    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:34:06.157411 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.157325    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.158277 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.158261    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.158355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.158291    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.158355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.158306    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.158355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.158333    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.168273 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.168254    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.168360 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.168277    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-186.ec2.internal\": node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:06.200661 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.200643    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:06.222532 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.222513    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"]
Sep 08 11:34:06.222615 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.222575    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.223410 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.223397    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.223476 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.223422    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.223476 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.223445    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.225621 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.225609    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.225767 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.225752    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.225832 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.225783    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.226285 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.226263    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.226369 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.226288    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.226369 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.226310    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.226369 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.226319    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.226369 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.226292    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.226544 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.226374    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.228670 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.228654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.228733 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.228687    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 11:34:06.229877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.229848    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 11:34:06.229970 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.229883    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 11:34:06.229970 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.229910    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeHasSufficientPID"
Sep 08 11:34:06.264237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.264208    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-186.ec2.internal\" not found" node="ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.268907 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.268888    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-186.ec2.internal\" not found" node="ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.289043 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.289015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b76a9a12b23f46d07ffcd26189b044dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"b76a9a12b23f46d07ffcd26189b044dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.289167 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.289047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b76a9a12b23f46d07ffcd26189b044dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"b76a9a12b23f46d07ffcd26189b044dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.289167 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.289073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7b8a435b6fb2d96183f4d8145fede99-config\") pod \"kube-apiserver-proxy-ip-10-0-143-186.ec2.internal\" (UID: \"b7b8a435b6fb2d96183f4d8145fede99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.301546 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.301513    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:06.389587 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.389546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b76a9a12b23f46d07ffcd26189b044dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"b76a9a12b23f46d07ffcd26189b044dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.389587 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.389590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7b8a435b6fb2d96183f4d8145fede99-config\") pod \"kube-apiserver-proxy-ip-10-0-143-186.ec2.internal\" (UID: \"b7b8a435b6fb2d96183f4d8145fede99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.389782 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.389612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b76a9a12b23f46d07ffcd26189b044dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"b76a9a12b23f46d07ffcd26189b044dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.389782 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.389654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b76a9a12b23f46d07ffcd26189b044dd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"b76a9a12b23f46d07ffcd26189b044dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.389782 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.389659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b76a9a12b23f46d07ffcd26189b044dd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal\" (UID: \"b76a9a12b23f46d07ffcd26189b044dd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.389782 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:06.389659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7b8a435b6fb2d96183f4d8145fede99-config\") pod \"kube-apiserver-proxy-ip-10-0-143-186.ec2.internal\" (UID: \"b7b8a435b6fb2d96183f4d8145fede99\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:06.401612 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.401584    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:06.502481 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:06.502449    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:07.920815 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:07.920774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:07.926812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:07.926796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:07.957304 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:07.957276    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:08.057817 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:08.057772    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:08.156952 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.156886    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:34:08.157855 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:08.157837    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:08.258355 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:08.258326    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:08.276527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.276495    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 11:34:08.276705 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.276687    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 11:34:08.276740 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.276701    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 11:34:08.359166 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:08.359135    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-186.ec2.internal\" not found"
Sep 08 11:34:08.378449 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.378400    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 11:29:07 +0000 UTC" deadline="2028-02-03 11:23:16.168329782 +0000 UTC"
Sep 08 11:34:08.378449 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.378435    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12311h49m7.789898016s"
Sep 08 11:34:08.398080 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.398057    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:34:08.416733 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.416681    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:34:08.441576 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.441527    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:08.451726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.451703    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 11:34:08.452772 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.452758    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal"
Sep 08 11:34:08.465348 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.465327    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 11:34:08.637421 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:08.637386    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b8a435b6fb2d96183f4d8145fede99.slice/crio-72cbb5eaf07c4e8d2876d9d46c825e7c6d821d86c1713d637fb1d87139521516 WatchSource:0}: Error finding container 72cbb5eaf07c4e8d2876d9d46c825e7c6d821d86c1713d637fb1d87139521516: Status 404 returned error can't find the container with id 72cbb5eaf07c4e8d2876d9d46c825e7c6d821d86c1713d637fb1d87139521516
Sep 08 11:34:08.637664 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:08.637640    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76a9a12b23f46d07ffcd26189b044dd.slice/crio-d3d0ce41288c6c2b6ba8d2372389cc8abb2637e621308363a02fd391b7258ec3 WatchSource:0}: Error finding container d3d0ce41288c6c2b6ba8d2372389cc8abb2637e621308363a02fd391b7258ec3: Status 404 returned error can't find the container with id d3d0ce41288c6c2b6ba8d2372389cc8abb2637e621308363a02fd391b7258ec3
Sep 08 11:34:08.641556 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:08.641534    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:34:09.323917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.323887    2577 apiserver.go:52] "Watching apiserver"
Sep 08 11:34:09.330958 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.330938    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 11:34:09.331331 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.331311    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-8t7xn","openshift-multus/network-metrics-daemon-rgtgk","openshift-dns/node-resolver-s7bdl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal","openshift-multus/multus-ht26j","openshift-network-diagnostics/network-check-target-fxbt8","openshift-network-operator/iptables-alerter-fqmrk","openshift-ovn-kubernetes/ovnkube-node-wv5lq","kube-system/global-pull-secret-syncer-5n8p5","kube-system/konnectivity-agent-qzjh2","kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x","openshift-cluster-node-tuning-operator/tuned-fg72r","openshift-image-registry/node-ca-fntz6"]
Sep 08 11:34:09.335130 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.335112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.337137 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.337117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.337756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.337742    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dbllf\""
Sep 08 11:34:09.337821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.337753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 11:34:09.337821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.337744    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 11:34:09.339228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.339196    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.339335 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.339205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xkbmj\""
Sep 08 11:34:09.339335 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.339308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.339440 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.339204    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.340622 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.340603    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 11:34:09.341171 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.341154    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.341259 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.341176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bs7pn\""
Sep 08 11:34:09.341321 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.341307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.341869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.341738    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.343548 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.343527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.343818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.343798    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c8htm\""
Sep 08 11:34:09.344077 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.343941    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.344982 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.344951    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 11:34:09.345095 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.345078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.347071 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.347053    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.347152 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.347105    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:09.347219 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.347163    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:09.347219 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.347193    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 11:34:09.347474 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.347460    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 11:34:09.347688 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.347671    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.347775 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.347759    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bwg98\""
Sep 08 11:34:09.349232 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.349216    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.349320 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.349269    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:09.350633 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-lib-modules\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.350707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-cni-binary-copy\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-kubelet\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ktl8\" (UniqueName: \"kubernetes.io/projected/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-kube-api-access-9ktl8\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-socket-dir-parent\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-cni-multus\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-system-cni-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-systemd\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-sys\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-multus-certs\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysctl-d\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-daemon-config\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-etc-kubernetes\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-var-lib-kubelet\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.350873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-host\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-host\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-cni-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-k8s-cni-cncf-io\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-cni-bin\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.350972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-conf-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edba5f2c-1eab-4ae4-9dff-6db20fb63f67-konnectivity-ca\") pod \"konnectivity-agent-qzjh2\" (UID: \"edba5f2c-1eab-4ae4-9dff-6db20fb63f67\") " pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysctl-conf\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwjv7\" (UniqueName: \"kubernetes.io/projected/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-kube-api-access-cwjv7\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-netns\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-hostroot\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-cnibin\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-modprobe-d\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27aadf16-bffa-4b4a-8590-d81e9e907798-tmp\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-hosts-file\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvdzp\" (UniqueName: \"kubernetes.io/projected/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-kube-api-access-bvdzp\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-serviceca\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.351421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edba5f2c-1eab-4ae4-9dff-6db20fb63f67-agent-certs\") pod \"konnectivity-agent-qzjh2\" (UID: \"edba5f2c-1eab-4ae4-9dff-6db20fb63f67\") " pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysconfig\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-kubernetes\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-run\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-tuned\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2zz5\" (UniqueName: \"kubernetes.io/projected/27aadf16-bffa-4b4a-8590-d81e9e907798-kube-api-access-q2zz5\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-tmp-dir\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.352047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.351484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.353576 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.353547    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.353790 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.353772    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 11:34:09.353790 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.353785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:09.353918 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.353801    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v9j9h\""
Sep 08 11:34:09.353918 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.353817    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.353918 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.353851    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:09.355007 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.354991    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 11:34:09.355992 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.355973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.357913 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.357886    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 11:34:09.358011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.357996    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jw4t7\""
Sep 08 11:34:09.358213 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.358200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.358298 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.358282    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 11:34:09.360028 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.360012    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s925j\""
Sep 08 11:34:09.360344 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.360326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 11:34:09.360418 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.360389    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 11:34:09.360671 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.360655    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.360755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.360737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.361217 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.361198    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.361217 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.361207    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 11:34:09.361340 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.361237    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 11:34:09.362677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.362663    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 11:34:09.363265 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.363246    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 11:34:09.363361 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.363282    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 11:34:09.363420 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.363362    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2d56m\""
Sep 08 11:34:09.376939 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.376922    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8bgd"
Sep 08 11:34:09.385154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.385136    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8bgd"
Sep 08 11:34:09.442390 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.442361    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 11:34:09.451769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.451910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-node-log\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.451910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-env-overrides\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.451910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-cni-multus\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.451910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66t2v\" (UniqueName: \"kubernetes.io/projected/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-kube-api-access-66t2v\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-cni-multus\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.451994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a98b045e-4843-4f46-a15e-841d04ff6faa-host-slash\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-slash\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-etc-kubernetes\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-etc-kubernetes\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.452135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cnibin\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-etc-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-ovn\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-host\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-host\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-conf-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-host\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovnkube-script-lib\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-conf-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-host\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-socket-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysctl-conf\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzk5\" (UniqueName: \"kubernetes.io/projected/6d373dd2-a382-4105-a368-b2c4c31177bf-kube-api-access-pbzk5\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-run-netns\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.452492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27aadf16-bffa-4b4a-8590-d81e9e907798-tmp\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-hosts-file\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvdzp\" (UniqueName: \"kubernetes.io/projected/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-kube-api-access-bvdzp\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysctl-conf\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-hosts-file\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lncxt\" (UniqueName: \"kubernetes.io/projected/07065e1e-cfb7-40f3-894d-c793ff6082c9-kube-api-access-lncxt\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40d06b34-232c-402a-95c0-ad2fdfd04e31-kubelet-config\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-kubelet\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovn-node-metrics-cert\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-tuned\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zz5\" (UniqueName: \"kubernetes.io/projected/27aadf16-bffa-4b4a-8590-d81e9e907798-kube-api-access-q2zz5\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-var-lib-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-cni-netd\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-kubelet\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-kubelet\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.453203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.452980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-socket-dir-parent\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgdqn\" (UniqueName: \"kubernetes.io/projected/a98b045e-4843-4f46-a15e-841d04ff6faa-kube-api-access-wgdqn\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-system-cni-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-systemd\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453050    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-socket-dir-parent\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-sys\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453096    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-multus-certs\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-systemd\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-systemd-units\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-system-cni-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-multus-certs\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-sys\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppqln\" (UniqueName: \"kubernetes.io/projected/755b8c6c-d324-4a9b-a9ab-f48040b37e83-kube-api-access-ppqln\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysctl-d\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-daemon-config\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-log-socket\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovnkube-config\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysctl-d\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-device-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-var-lib-kubelet\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-cni-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-var-lib-kubelet\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-k8s-cni-cncf-io\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-cni-bin\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-cni-dir\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453609    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-k8s-cni-cncf-io\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-var-lib-cni-bin\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-system-cni-dir\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.454869 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edba5f2c-1eab-4ae4-9dff-6db20fb63f67-konnectivity-ca\") pod \"konnectivity-agent-qzjh2\" (UID: \"edba5f2c-1eab-4ae4-9dff-6db20fb63f67\") " pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwjv7\" (UniqueName: \"kubernetes.io/projected/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-kube-api-access-cwjv7\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-netns\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-hostroot\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-sys-fs\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a98b045e-4843-4f46-a15e-841d04ff6faa-iptables-alerter-script\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-registration-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-cnibin\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-modprobe-d\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-serviceca\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-systemd\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edba5f2c-1eab-4ae4-9dff-6db20fb63f67-agent-certs\") pod \"konnectivity-agent-qzjh2\" (UID: \"edba5f2c-1eab-4ae4-9dff-6db20fb63f67\") " pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.453991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysconfig\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-kubernetes\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-run\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.455789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-tmp-dir\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-cni-bin\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454092    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-multus-daemon-config\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-lib-modules\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-lib-modules\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-cni-binary-copy\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-sysconfig\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ktl8\" (UniqueName: \"kubernetes.io/projected/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-kube-api-access-9ktl8\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-kubernetes\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40d06b34-232c-402a-95c0-ad2fdfd04e31-dbus\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-run\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/edba5f2c-1eab-4ae4-9dff-6db20fb63f67-konnectivity-ca\") pod \"konnectivity-agent-qzjh2\" (UID: \"edba5f2c-1eab-4ae4-9dff-6db20fb63f67\") " pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-host-run-netns\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-hostroot\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-cnibin\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-tmp-dir\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-serviceca\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-modprobe-d\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.456552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.454722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-cni-binary-copy\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.457603 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.457121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/27aadf16-bffa-4b4a-8590-d81e9e907798-etc-tuned\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.457603 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.457364    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/edba5f2c-1eab-4ae4-9dff-6db20fb63f67-agent-certs\") pod \"konnectivity-agent-qzjh2\" (UID: \"edba5f2c-1eab-4ae4-9dff-6db20fb63f67\") " pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.458540 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.458522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27aadf16-bffa-4b4a-8590-d81e9e907798-tmp\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.464067 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.464047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvdzp\" (UniqueName: \"kubernetes.io/projected/0508f594-1ab3-46a7-9f2a-74b0cae0b4cc-kube-api-access-bvdzp\") pod \"node-resolver-s7bdl\" (UID: \"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc\") " pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.464237 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.464217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2zz5\" (UniqueName: \"kubernetes.io/projected/27aadf16-bffa-4b4a-8590-d81e9e907798-kube-api-access-q2zz5\") pod \"tuned-fg72r\" (UID: \"27aadf16-bffa-4b4a-8590-d81e9e907798\") " pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.464709 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.464689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwjv7\" (UniqueName: \"kubernetes.io/projected/ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb-kube-api-access-cwjv7\") pod \"node-ca-fntz6\" (UID: \"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb\") " pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.465121 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.465099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ktl8\" (UniqueName: \"kubernetes.io/projected/b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d-kube-api-access-9ktl8\") pod \"multus-ht26j\" (UID: \"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d\") " pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.481072 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.481023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal" event={"ID":"b7b8a435b6fb2d96183f4d8145fede99","Type":"ContainerStarted","Data":"72cbb5eaf07c4e8d2876d9d46c825e7c6d821d86c1713d637fb1d87139521516"}
Sep 08 11:34:09.482140 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.482117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"b76a9a12b23f46d07ffcd26189b044dd","Type":"ContainerStarted","Data":"d3d0ce41288c6c2b6ba8d2372389cc8abb2637e621308363a02fd391b7258ec3"}
Sep 08 11:34:09.554502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554457    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-sys-fs\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.554502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a98b045e-4843-4f46-a15e-841d04ff6faa-iptables-alerter-script\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-registration-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-systemd\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-cni-bin\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40d06b34-232c-402a-95c0-ad2fdfd04e31-dbus\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-node-log\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-env-overrides\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66t2v\" (UniqueName: \"kubernetes.io/projected/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-kube-api-access-66t2v\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a98b045e-4843-4f46-a15e-841d04ff6faa-host-slash\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-slash\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.554802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cnibin\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-etc-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-ovn\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-systemd\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovnkube-script-lib\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-cni-bin\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-sys-fs\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-socket-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.554990    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzk5\" (UniqueName: \"kubernetes.io/projected/6d373dd2-a382-4105-a368-b2c4c31177bf-kube-api-access-pbzk5\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-run-netns\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.555068    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.555080    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:10.055041794 +0000 UTC m=+3.071834583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lncxt\" (UniqueName: \"kubernetes.io/projected/07065e1e-cfb7-40f3-894d-c793ff6082c9-kube-api-access-lncxt\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:09.555877 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.555126    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:10.055111007 +0000 UTC m=+3.071903794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40d06b34-232c-402a-95c0-ad2fdfd04e31-kubelet-config\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a98b045e-4843-4f46-a15e-841d04ff6faa-iptables-alerter-script\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-kubelet\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.554878    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-registration-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovn-node-metrics-cert\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555222    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-node-log\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-var-lib-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-cni-netd\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgdqn\" (UniqueName: \"kubernetes.io/projected/a98b045e-4843-4f46-a15e-841d04ff6faa-kube-api-access-wgdqn\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-systemd-units\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-run-netns\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.556769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppqln\" (UniqueName: \"kubernetes.io/projected/755b8c6c-d324-4a9b-a9ab-f48040b37e83-kube-api-access-ppqln\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-cni-netd\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-log-socket\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovnkube-config\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-socket-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-device-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555596    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40d06b34-232c-402a-95c0-ad2fdfd04e31-kubelet-config\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-system-cni-dir\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cnibin\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555651    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-var-lib-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-kubelet\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40d06b34-232c-402a-95c0-ad2fdfd04e31-dbus\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-run-ovn\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.557579 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-log-socket\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-slash\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovnkube-script-lib\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.555973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a98b045e-4843-4f46-a15e-841d04ff6faa-host-slash\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-env-overrides\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-etc-openvswitch\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-system-cni-dir\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-device-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-systemd-units\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/755b8c6c-d324-4a9b-a9ab-f48040b37e83-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6d373dd2-a382-4105-a368-b2c4c31177bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.556412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovnkube-config\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.558685 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.557102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.560603 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.560185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/755b8c6c-d324-4a9b-a9ab-f48040b37e83-ovn-node-metrics-cert\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.570026 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.569904    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:09.570026 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.569935    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:09.570026 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.569951    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:09.570240 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:09.570224    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:10.070021243 +0000 UTC m=+3.086814024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:09.575103 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.575050    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lncxt\" (UniqueName: \"kubernetes.io/projected/07065e1e-cfb7-40f3-894d-c793ff6082c9-kube-api-access-lncxt\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:09.575401 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.575383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgdqn\" (UniqueName: \"kubernetes.io/projected/a98b045e-4843-4f46-a15e-841d04ff6faa-kube-api-access-wgdqn\") pod \"iptables-alerter-fqmrk\" (UID: \"a98b045e-4843-4f46-a15e-841d04ff6faa\") " pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.576118 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.576094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzk5\" (UniqueName: \"kubernetes.io/projected/6d373dd2-a382-4105-a368-b2c4c31177bf-kube-api-access-pbzk5\") pod \"aws-ebs-csi-driver-node-kdl4x\" (UID: \"6d373dd2-a382-4105-a368-b2c4c31177bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.582388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.582362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppqln\" (UniqueName: \"kubernetes.io/projected/755b8c6c-d324-4a9b-a9ab-f48040b37e83-kube-api-access-ppqln\") pod \"ovnkube-node-wv5lq\" (UID: \"755b8c6c-d324-4a9b-a9ab-f48040b37e83\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.582941 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.582917    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66t2v\" (UniqueName: \"kubernetes.io/projected/23f5d473-3c46-4df6-8fe4-603d2bab0ac1-kube-api-access-66t2v\") pod \"multus-additional-cni-plugins-8t7xn\" (UID: \"23f5d473-3c46-4df6-8fe4-603d2bab0ac1\") " pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.647909 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.647875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:09.652982 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.652266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fg72r"
Sep 08 11:34:09.659931 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.659894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s7bdl"
Sep 08 11:34:09.663683 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.663662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fntz6"
Sep 08 11:34:09.669364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.669345    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ht26j"
Sep 08 11:34:09.670607 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.670550    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27aadf16_bffa_4b4a_8590_d81e9e907798.slice/crio-bad234a3878e53f7d02e702acc49032451317b73f6328094cb947283f10dbcbc WatchSource:0}: Error finding container bad234a3878e53f7d02e702acc49032451317b73f6328094cb947283f10dbcbc: Status 404 returned error can't find the container with id bad234a3878e53f7d02e702acc49032451317b73f6328094cb947283f10dbcbc
Sep 08 11:34:09.675290 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.675177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fqmrk"
Sep 08 11:34:09.675998 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.675975    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0508f594_1ab3_46a7_9f2a_74b0cae0b4cc.slice/crio-4c9bc19d94e7c72642689e9c2f77b380a34df60bcde8e6379ad02320813f218d WatchSource:0}: Error finding container 4c9bc19d94e7c72642689e9c2f77b380a34df60bcde8e6379ad02320813f218d: Status 404 returned error can't find the container with id 4c9bc19d94e7c72642689e9c2f77b380a34df60bcde8e6379ad02320813f218d
Sep 08 11:34:09.676795 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.676773    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef82f585_2bd9_43c8_9b25_fea2e2b6fcbb.slice/crio-d292dac424ec9905993eba7cca44e6fd2cafde38b9328b6c2a75e3dd9293991d WatchSource:0}: Error finding container d292dac424ec9905993eba7cca44e6fd2cafde38b9328b6c2a75e3dd9293991d: Status 404 returned error can't find the container with id d292dac424ec9905993eba7cca44e6fd2cafde38b9328b6c2a75e3dd9293991d
Sep 08 11:34:09.680880 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.680858    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8t7xn"
Sep 08 11:34:09.686244 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.686226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:09.690679 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.690663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x"
Sep 08 11:34:09.696498 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.696456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98b045e_4843_4f46_a15e_841d04ff6faa.slice/crio-5db1db28f00f4111f2c478c43836be6cb8321c10ec162d6c03a02b4521984ef4 WatchSource:0}: Error finding container 5db1db28f00f4111f2c478c43836be6cb8321c10ec162d6c03a02b4521984ef4: Status 404 returned error can't find the container with id 5db1db28f00f4111f2c478c43836be6cb8321c10ec162d6c03a02b4521984ef4
Sep 08 11:34:09.698690 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.698646    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f5d473_3c46_4df6_8fe4_603d2bab0ac1.slice/crio-86f94521ef2e7f808dbbff59ef277e12e3990e91ba78b7a1fa6df3deba85f08b WatchSource:0}: Error finding container 86f94521ef2e7f808dbbff59ef277e12e3990e91ba78b7a1fa6df3deba85f08b: Status 404 returned error can't find the container with id 86f94521ef2e7f808dbbff59ef277e12e3990e91ba78b7a1fa6df3deba85f08b
Sep 08 11:34:09.709349 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.709198    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755b8c6c_d324_4a9b_a9ab_f48040b37e83.slice/crio-e79c0388ef8a9d86f07960ff7865f6a3e2f7ac6679e6b5749198fa77975cd126 WatchSource:0}: Error finding container e79c0388ef8a9d86f07960ff7865f6a3e2f7ac6679e6b5749198fa77975cd126: Status 404 returned error can't find the container with id e79c0388ef8a9d86f07960ff7865f6a3e2f7ac6679e6b5749198fa77975cd126
Sep 08 11:34:09.709447 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:09.709400    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d373dd2_a382_4105_a368_b2c4c31177bf.slice/crio-da6cdb43b0d9cdf9eb846a25574492f0740b0c84bb05062a5a7af4daa65c4c0a WatchSource:0}: Error finding container da6cdb43b0d9cdf9eb846a25574492f0740b0c84bb05062a5a7af4daa65c4c0a: Status 404 returned error can't find the container with id da6cdb43b0d9cdf9eb846a25574492f0740b0c84bb05062a5a7af4daa65c4c0a
Sep 08 11:34:09.859302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:09.859211    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:34:10.060650 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.060618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:10.060650 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.060663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:10.060915 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.060803    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:10.060915 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.060816    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:10.060915 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.060867    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:11.060850504 +0000 UTC m=+4.077643284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:10.060915 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.060883    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:11.060876836 +0000 UTC m=+4.077669602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:10.162073 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.161986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:10.162230 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.162153    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:10.162230 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.162184    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:10.162230 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.162199    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:10.162350 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:10.162261    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:11.162246733 +0000 UTC m=+4.179039515 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:10.388756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.388678    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 11:29:09 +0000 UTC" deadline="2028-03-22 08:27:37.859807765 +0000 UTC"
Sep 08 11:34:10.388756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.388738    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13460h53m27.471074273s"
Sep 08 11:34:10.485864 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.485693    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x" event={"ID":"6d373dd2-a382-4105-a368-b2c4c31177bf","Type":"ContainerStarted","Data":"da6cdb43b0d9cdf9eb846a25574492f0740b0c84bb05062a5a7af4daa65c4c0a"}
Sep 08 11:34:10.487354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.487305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerStarted","Data":"86f94521ef2e7f808dbbff59ef277e12e3990e91ba78b7a1fa6df3deba85f08b"}
Sep 08 11:34:10.489650 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.489624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ht26j" event={"ID":"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d","Type":"ContainerStarted","Data":"10de57cd14d4a5128bfcdc3fc029347bf3e6083726fa8d7afb66aefd371a4773"}
Sep 08 11:34:10.491550 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.491522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fntz6" event={"ID":"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb","Type":"ContainerStarted","Data":"d292dac424ec9905993eba7cca44e6fd2cafde38b9328b6c2a75e3dd9293991d"}
Sep 08 11:34:10.493629 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.493555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s7bdl" event={"ID":"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc","Type":"ContainerStarted","Data":"4c9bc19d94e7c72642689e9c2f77b380a34df60bcde8e6379ad02320813f218d"}
Sep 08 11:34:10.496599 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.496498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qzjh2" event={"ID":"edba5f2c-1eab-4ae4-9dff-6db20fb63f67","Type":"ContainerStarted","Data":"7ded6d22dd1ee75e43883e1a84ee941d6ebfb6af6993395c188e0d0125d5202b"}
Sep 08 11:34:10.498614 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.498585    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"e79c0388ef8a9d86f07960ff7865f6a3e2f7ac6679e6b5749198fa77975cd126"}
Sep 08 11:34:10.500376 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.500352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fqmrk" event={"ID":"a98b045e-4843-4f46-a15e-841d04ff6faa","Type":"ContainerStarted","Data":"5db1db28f00f4111f2c478c43836be6cb8321c10ec162d6c03a02b4521984ef4"}
Sep 08 11:34:10.502141 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.502118    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fg72r" event={"ID":"27aadf16-bffa-4b4a-8590-d81e9e907798","Type":"ContainerStarted","Data":"bad234a3878e53f7d02e702acc49032451317b73f6328094cb947283f10dbcbc"}
Sep 08 11:34:10.963474 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:10.963442    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 11:34:11.070972 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.070236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:11.070972 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.070292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:11.070972 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.070425    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:11.070972 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.070484    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:13.070467672 +0000 UTC m=+6.087260441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:11.070972 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.070882    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:11.070972 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.070930    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:13.070915429 +0000 UTC m=+6.087708200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:11.170677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.170635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:11.170861 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.170811    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:11.170861 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.170840    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:11.170861 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.170856    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:11.171018 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.170924    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:13.170902223 +0000 UTC m=+6.187695003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:11.389705 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.389659    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 11:29:09 +0000 UTC" deadline="2028-02-02 08:36:06.733698422 +0000 UTC"
Sep 08 11:34:11.389705 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.389705    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12285h1m55.343998617s"
Sep 08 11:34:11.482069 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.481843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:11.482069 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.481967    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:11.482069 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.482066    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:11.482334 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.482136    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:11.482334 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:11.482195    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:11.482334 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:11.482279    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:12.534851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:12.534501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal" event={"ID":"b7b8a435b6fb2d96183f4d8145fede99","Type":"ContainerStarted","Data":"4b7680d942b4a7dd7b8465dfbcf7f242b63f00fca49c8665b313f599da926596"}
Sep 08 11:34:12.548681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:12.548138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"b76a9a12b23f46d07ffcd26189b044dd","Type":"ContainerStarted","Data":"a204ed47e361ba5c0e268425284b5a87b268eb2af36e8f9cd8eb93ab82c10523"}
Sep 08 11:34:12.569786 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:12.569651    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-186.ec2.internal" podStartSLOduration=4.56962954 podStartE2EDuration="4.56962954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:12.552340923 +0000 UTC m=+5.569133713" watchObservedRunningTime="2026-09-08 11:34:12.56962954 +0000 UTC m=+5.586422331"
Sep 08 11:34:13.088882 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:13.088824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:13.089070 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:13.088916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:13.089070 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.089034    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:13.089185 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.089095    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:17.089076693 +0000 UTC m=+10.105869458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:13.089185 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.089155    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:13.089292 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.089189    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:17.089176823 +0000 UTC m=+10.105969595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:13.189907 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:13.189866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:13.190124 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.190096    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:13.190194 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.190134    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:13.190194 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.190147    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:13.190298 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.190205    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:17.190186441 +0000 UTC m=+10.206979221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:13.477756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:13.477674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:13.477756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:13.477688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:13.477976 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.477847    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:13.478320 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.478292    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:13.478424 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:13.478363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:13.478476 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:13.478436    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:15.477128 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:15.477098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:15.477616 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:15.477138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:15.477616 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:15.477098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:15.477616 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:15.477229    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:15.477616 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:15.477307    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:15.477616 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:15.477412    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:15.557078 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:15.557042    2577 generic.go:356] "Generic (PLEG): container finished" podID="b76a9a12b23f46d07ffcd26189b044dd" containerID="a204ed47e361ba5c0e268425284b5a87b268eb2af36e8f9cd8eb93ab82c10523" exitCode=0
Sep 08 11:34:15.557252 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:15.557100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"b76a9a12b23f46d07ffcd26189b044dd","Type":"ContainerDied","Data":"a204ed47e361ba5c0e268425284b5a87b268eb2af36e8f9cd8eb93ab82c10523"}
Sep 08 11:34:17.125427 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:17.125383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:17.126053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:17.125450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:17.126053 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.125595    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:17.126053 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.125656    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:25.125638802 +0000 UTC m=+18.142431570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:17.126235 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.126071    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:17.126235 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.126122    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:25.126106973 +0000 UTC m=+18.142899739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:17.226779 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:17.226740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:17.226946 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.226927    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:17.227003 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.226946    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:17.227003 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.226959    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:17.227127 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.227021    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:25.22700412 +0000 UTC m=+18.243796893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:17.479684 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:17.479600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:17.479843 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.479747    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:17.479843 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:17.479825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:17.479996 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.479953    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:17.480615 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:17.480547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:17.481034 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:17.481007    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:19.477262 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:19.477221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:19.477665 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:19.477221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:19.477665 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:19.477336    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:19.477665 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:19.477363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:19.477665 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:19.477446    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:19.477665 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:19.477547    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:21.477022 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:21.476988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:21.477508 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:21.476997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:21.477508 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:21.477102    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:21.477508 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:21.477178    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:21.477508 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:21.477221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:21.477508 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:21.477330    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:23.477040 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:23.477006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:23.477040 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:23.477040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:23.477588 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:23.477012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:23.477588 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:23.477134    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:23.477588 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:23.477193    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:23.477588 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:23.477300    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:25.184827 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:25.184786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:25.184827 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:25.184838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:25.185513 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.184946    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:25.185513 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.184962    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:25.185513 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.185006    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:41.184988431 +0000 UTC m=+34.201781206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:25.185513 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.185024    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:41.185015825 +0000 UTC m=+34.201808591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:25.285690 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:25.285645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:25.285872 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.285854    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:25.285926 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.285884    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:25.285926 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.285899    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:25.286034 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.285973    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:41.285947604 +0000 UTC m=+34.302740384 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:25.477484 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:25.477397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:25.477669 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:25.477397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:25.477669 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:25.477397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:25.477669 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.477558    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:25.477669 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.477638    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:25.477853 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:25.477732    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:27.478221 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:27.478190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:27.478707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:27.478308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:27.478707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:27.478325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:27.478707 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:27.478323    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:27.478707 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:27.478454    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:27.478707 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:27.478533    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:28.586826 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.586636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x" event={"ID":"6d373dd2-a382-4105-a368-b2c4c31177bf","Type":"ContainerStarted","Data":"26a5d8eb695a4c8e47d90cba5f036694762463cd58a4a1e186a57b21f8bfe6b4"}
Sep 08 11:34:28.588315 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.588284    2577 generic.go:356] "Generic (PLEG): container finished" podID="23f5d473-3c46-4df6-8fe4-603d2bab0ac1" containerID="ed3cb0c636e7813e11afa7963205d5a0d60c5fd2f13da5ba0b44592e4274ef47" exitCode=0
Sep 08 11:34:28.588418 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.588364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerDied","Data":"ed3cb0c636e7813e11afa7963205d5a0d60c5fd2f13da5ba0b44592e4274ef47"}
Sep 08 11:34:28.590168 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.590133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ht26j" event={"ID":"b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d","Type":"ContainerStarted","Data":"76fdd3a3385b5f369b1fdf556b2c748902999edc7d499222fedfd2fecc5e38e0"}
Sep 08 11:34:28.592110 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.592084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fntz6" event={"ID":"ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb","Type":"ContainerStarted","Data":"890a0591fbb2616ce4711ba16a3a6ad8501c46cdf7438c42e42c835ef9ca8ba8"}
Sep 08 11:34:28.593732 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.593696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s7bdl" event={"ID":"0508f594-1ab3-46a7-9f2a-74b0cae0b4cc","Type":"ContainerStarted","Data":"1983c511038163daae5d09a0d9f52b41525f69de126ed229e8d4906435fb1f98"}
Sep 08 11:34:28.597891 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.597862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qzjh2" event={"ID":"edba5f2c-1eab-4ae4-9dff-6db20fb63f67","Type":"ContainerStarted","Data":"febdad1a80b27104377e33841df2f89d3f05387a0a185e5d77e340667febf31d"}
Sep 08 11:34:28.599846 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.599825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" event={"ID":"b76a9a12b23f46d07ffcd26189b044dd","Type":"ContainerStarted","Data":"4576ba6fd115c541717043baf64adc905c0993db43e88d3eb3f42f74cf6e847f"}
Sep 08 11:34:28.601606 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.601581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"eb39f0cf3fb710f97425d5891dcd3f2b50743a598e382472e9348c4c40a35595"}
Sep 08 11:34:28.603147 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.603124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fg72r" event={"ID":"27aadf16-bffa-4b4a-8590-d81e9e907798","Type":"ContainerStarted","Data":"fc5d366709ccd1c879d8b092748d6dfd2dacb5d4da243a9e50c150951cd962f8"}
Sep 08 11:34:28.632217 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.632162    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qzjh2" podStartSLOduration=3.677385686 podStartE2EDuration="21.632142178s" totalImagesPullingTime="17.954756492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:28.631501543 +0000 UTC m=+21.648294332" watchObservedRunningTime="2026-09-08 11:34:28.632142178 +0000 UTC m=+21.648934967"
Sep 08 11:34:28.649229 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.649177    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fg72r" podStartSLOduration=3.698235805 podStartE2EDuration="21.649157459s" totalImagesPullingTime="17.950921654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:28.648893305 +0000 UTC m=+21.665686119" watchObservedRunningTime="2026-09-08 11:34:28.649157459 +0000 UTC m=+21.665950249"
Sep 08 11:34:28.670515 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.670464    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ht26j" podStartSLOduration=3.6974092389999997 podStartE2EDuration="21.670442827s" totalImagesPullingTime="17.973033588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:28.670187584 +0000 UTC m=+21.686980373" watchObservedRunningTime="2026-09-08 11:34:28.670442827 +0000 UTC m=+21.687235618"
Sep 08 11:34:28.689191 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.689142    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s7bdl" podStartSLOduration=3.757102449 podStartE2EDuration="21.689122857s" totalImagesPullingTime="17.932020408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:28.689099623 +0000 UTC m=+21.705892411" watchObservedRunningTime="2026-09-08 11:34:28.689122857 +0000 UTC m=+21.705915657"
Sep 08 11:34:28.732613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.732457    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fntz6" podStartSLOduration=3.801961517 podStartE2EDuration="21.732444367s" totalImagesPullingTime="17.93048285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:28.717304204 +0000 UTC m=+21.734096993" watchObservedRunningTime="2026-09-08 11:34:28.732444367 +0000 UTC m=+21.749237155"
Sep 08 11:34:28.732840 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:28.732798    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-186.ec2.internal" podStartSLOduration=20.732790426 podStartE2EDuration="20.732790426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:28.732007151 +0000 UTC m=+21.748799940" watchObservedRunningTime="2026-09-08 11:34:28.732790426 +0000 UTC m=+21.749583213"
Sep 08 11:34:29.476794 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.476709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:29.476794 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.476709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:29.476999 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:29.476825    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:29.476999 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.476733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:29.476999 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:29.476908    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:29.476999 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:29.476941    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:29.609224 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609150    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:34:29.609860 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609553    2577 generic.go:356] "Generic (PLEG): container finished" podID="755b8c6c-d324-4a9b-a9ab-f48040b37e83" containerID="0778c9a4fd91254a797ab9de4111451f7b4053e8bb92b123f91174a971a1f3d3" exitCode=1
Sep 08 11:34:29.609860 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"ba23b0493ed8a0ad29e0ada627196ba62a01d4fee29f0f5e8f867eb7f403cf3b"}
Sep 08 11:34:29.609860 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609736    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"f51c4faee3a20f4971287178897409776c506cee0c54e7472b0832e1cc87ba36"}
Sep 08 11:34:29.609860 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"97d6cab159379210f4eade9e70decf345bd5c1e97b439abb13cf8ec219baf920"}
Sep 08 11:34:29.609860 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609836    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"b0eb187ab5f22ea0e8e8c07c1efee39af4c86bc85710f6c4b9f99f5e5197c8fb"}
Sep 08 11:34:29.610079 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.609883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerDied","Data":"0778c9a4fd91254a797ab9de4111451f7b4053e8bb92b123f91174a971a1f3d3"}
Sep 08 11:34:29.611678 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.611647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fqmrk" event={"ID":"a98b045e-4843-4f46-a15e-841d04ff6faa","Type":"ContainerStarted","Data":"085085e7cb2034c52f120d1e42a17cfee06bf8671d321b4d44ba09855782dcc3"}
Sep 08 11:34:29.631411 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.631316    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fqmrk" podStartSLOduration=4.7036518449999996 podStartE2EDuration="22.631295034s" totalImagesPullingTime="17.927643189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:29.630966686 +0000 UTC m=+22.647759473" watchObservedRunningTime="2026-09-08 11:34:29.631295034 +0000 UTC m=+22.648087826"
Sep 08 11:34:29.660992 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:29.660961    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 11:34:30.425904 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:30.425806    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T11:34:29.660987561Z","UUID":"ee636fb5-470e-4a11-85d6-e042a3c0cbac","Handler":null,"Name":"","Endpoint":""}
Sep 08 11:34:30.427835 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:30.427810    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 11:34:30.427968 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:30.427846    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 11:34:30.616640 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:30.616605    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x" event={"ID":"6d373dd2-a382-4105-a368-b2c4c31177bf","Type":"ContainerStarted","Data":"0e6375234bcde1e69bb749243196997c204f018f222a77f72899383126066706"}
Sep 08 11:34:31.031105 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.031075    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:31.031632 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.031606    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:31.476894 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.476848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:31.477075 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.476848    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:31.477075 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:31.476968    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:31.477075 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.476864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:31.477075 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:31.477047    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:31.477288 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:31.477144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:31.621359 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.621318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x" event={"ID":"6d373dd2-a382-4105-a368-b2c4c31177bf","Type":"ContainerStarted","Data":"5ed303b116430a03e0f330eb2740f8b57487588a2df485c3dc214b3d6d99ad9d"}
Sep 08 11:34:31.621856 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.621434    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:31.622370 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.622342    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qzjh2"
Sep 08 11:34:31.639782 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:31.639739    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kdl4x" podStartSLOduration=4.053271537 podStartE2EDuration="24.639727158s" totalImagesPullingTime="20.586455621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:31.639558611 +0000 UTC m=+24.656351399" watchObservedRunningTime="2026-09-08 11:34:31.639727158 +0000 UTC m=+24.656519980"
Sep 08 11:34:32.627951 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:32.627920    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:34:32.628412 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:32.628381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"6bf66479df0db6055bb6628059ed3f63f02c8b03d23b755240723b966592f189"}
Sep 08 11:34:33.477482 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:33.477452    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:33.477482 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:33.477474    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:33.477781 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:33.477591    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:33.477781 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:33.477662    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:33.477781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:33.477704    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:33.477781 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:33.477777    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:34.636838 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.636674    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:34:34.637252 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.637184    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"f30c3488654102a86cff8e05156cd733069c3bae9ce0cf9987e88c68dbb42664"}
Sep 08 11:34:34.637917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.637891    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:34.642151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.638510    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:34.642151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.638636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:34.642151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.639078    2577 scope.go:117] "RemoveContainer" containerID="0778c9a4fd91254a797ab9de4111451f7b4053e8bb92b123f91174a971a1f3d3"
Sep 08 11:34:34.643026 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.642992    2577 generic.go:356] "Generic (PLEG): container finished" podID="23f5d473-3c46-4df6-8fe4-603d2bab0ac1" containerID="8233ec5d3f3f907ea8af552cc65dadc386adbd24ec9e3a465bbda806058578b6" exitCode=0
Sep 08 11:34:34.643181 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.643037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerDied","Data":"8233ec5d3f3f907ea8af552cc65dadc386adbd24ec9e3a465bbda806058578b6"}
Sep 08 11:34:34.654982 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.654963    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:34.656142 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:34.656126    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:34:35.477068 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.477038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:35.477355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.477038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:35.477355 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:35.477169    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:35.477355 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:35.477232    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:35.477355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.477038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:35.477355 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:35.477319    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:35.649402 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.649377    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:34:35.649903 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.649821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" event={"ID":"755b8c6c-d324-4a9b-a9ab-f48040b37e83","Type":"ContainerStarted","Data":"b238da61d01843608fd174cbfd372b3ddf3dd2529e507b564f51a6bd4a416d95"}
Sep 08 11:34:35.683156 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.682878    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq" podStartSLOduration=9.903437037 podStartE2EDuration="28.682856424s" totalImagesPullingTime="18.779419387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:35.681670439 +0000 UTC m=+28.698463228" watchObservedRunningTime="2026-09-08 11:34:35.682856424 +0000 UTC m=+28.699649213"
Sep 08 11:34:35.857854 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.857828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fxbt8"]
Sep 08 11:34:35.858002 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.857988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:35.858119 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:35.858097    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:35.860387 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.860356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5n8p5"]
Sep 08 11:34:35.860501 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.860451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:35.860581 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:35.860548    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:35.875026 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.875001    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rgtgk"]
Sep 08 11:34:35.875114 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:35.875107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:35.875231 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:35.875211    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:36.654391 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:36.654356    2577 generic.go:356] "Generic (PLEG): container finished" podID="23f5d473-3c46-4df6-8fe4-603d2bab0ac1" containerID="466bfe9b81f24ae2d06371849cac1154947a03a4cd3b33e55a902275e6f4cc60" exitCode=0
Sep 08 11:34:36.654882 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:36.654442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerDied","Data":"466bfe9b81f24ae2d06371849cac1154947a03a4cd3b33e55a902275e6f4cc60"}
Sep 08 11:34:37.477464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:37.477427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:37.477726 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:37.477548    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:37.477726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:37.477607    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:37.477726 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:37.477678    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:37.477726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:37.477702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:37.477937 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:37.477782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:38.664502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:38.664275    2577 generic.go:356] "Generic (PLEG): container finished" podID="23f5d473-3c46-4df6-8fe4-603d2bab0ac1" containerID="6ffa4db9cf195262beef116e998a7fb53e49e36d4fb8719e6504411c4f8dc62a" exitCode=0
Sep 08 11:34:38.665004 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:38.664387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerDied","Data":"6ffa4db9cf195262beef116e998a7fb53e49e36d4fb8719e6504411c4f8dc62a"}
Sep 08 11:34:39.476844 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:39.476808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:39.477044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:39.476808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:39.477044 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:39.476926    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:39.477044 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:39.477028    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:39.477237 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:39.476807    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:39.477237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:39.477173    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:41.191889 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.191856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:41.192487 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.191899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:41.192487 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.192046    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:41.192487 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.192049    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:41.192487 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.192104    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret podName:40d06b34-232c-402a-95c0-ad2fdfd04e31 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.19209078 +0000 UTC m=+66.208883546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret") pod "global-pull-secret-syncer-5n8p5" (UID: "40d06b34-232c-402a-95c0-ad2fdfd04e31") : object "kube-system"/"original-pull-secret" not registered
Sep 08 11:34:41.192487 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.192250    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.192229218 +0000 UTC m=+66.209022005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 11:34:41.292576 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.292543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:41.292748 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.292713    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 11:34:41.292748 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.292734    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 11:34:41.292748 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.292746    2577 projected.go:196] Error preparing data for projected volume kube-api-access-kr6tm for pod openshift-network-diagnostics/network-check-target-fxbt8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:41.292862 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.292794    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm podName:aa1a0924-1237-4815-bef5-1163a4e27167 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.292780828 +0000 UTC m=+66.309573605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kr6tm" (UniqueName: "kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm") pod "network-check-target-fxbt8" (UID: "aa1a0924-1237-4815-bef5-1163a4e27167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 11:34:41.477393 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.477299    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:41.477582 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.477303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:41.477582 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.477439    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fxbt8" podUID="aa1a0924-1237-4815-bef5-1163a4e27167"
Sep 08 11:34:41.477582 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.477299    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:41.477582 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.477528    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rgtgk" podUID="07065e1e-cfb7-40f3-894d-c793ff6082c9"
Sep 08 11:34:41.477788 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.477636    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5n8p5" podUID="40d06b34-232c-402a-95c0-ad2fdfd04e31"
Sep 08 11:34:41.697013 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.696987    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-186.ec2.internal" event="NodeReady"
Sep 08 11:34:41.697187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.697136    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 11:34:41.733871 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.733792    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-598c48c5fb-7xrn5"]
Sep 08 11:34:41.755729 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.755686    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-598c48c5fb-7xrn5"]
Sep 08 11:34:41.755729 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.755733    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4kdd9"]
Sep 08 11:34:41.756094 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.756070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.758674 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.758523    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 11:34:41.758674 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.758620    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 11:34:41.758674 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.758645    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 11:34:41.758955 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.758932    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-28gvn\""
Sep 08 11:34:41.766350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.766327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 11:34:41.770280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.770258    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zg574"]
Sep 08 11:34:41.770385 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.770349    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.772666 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.772649    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9hjq\""
Sep 08 11:34:41.772848 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.772792    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 11:34:41.772848 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.772841    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 11:34:41.787770 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.787740    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zg574"]
Sep 08 11:34:41.787899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.787783    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4kdd9"]
Sep 08 11:34:41.787899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.787885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:41.790272 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.790248    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 11:34:41.790412 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.790288    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gw5kv\""
Sep 08 11:34:41.790412 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.790367    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 11:34:41.790412 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.790375    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 11:34:41.896611 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-bound-sa-token\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.896611 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-certificates\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4mjh\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-kube-api-access-s4mjh\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40925518-6cf8-4a53-8691-1f2ba1620173-cert\") pod \"ingress-canary-zg574\" (UID: \"40925518-6cf8-4a53-8691-1f2ba1620173\") " pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-config-volume\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75sk\" (UniqueName: \"kubernetes.io/projected/40925518-6cf8-4a53-8691-1f2ba1620173-kube-api-access-x75sk\") pod \"ingress-canary-zg574\" (UID: \"40925518-6cf8-4a53-8691-1f2ba1620173\") " pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a310ac-d5de-4a56-b452-fa059e23e234-ca-trust-extracted\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.896855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-trusted-ca\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.897208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-installation-pull-secrets\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.897208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896891    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.897208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-tmp-dir\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.897208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jk9b\" (UniqueName: \"kubernetes.io/projected/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-kube-api-access-2jk9b\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.897208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.896959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-image-registry-private-configuration\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.997964 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.997878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4mjh\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-kube-api-access-s4mjh\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.997964 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.997935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40925518-6cf8-4a53-8691-1f2ba1620173-cert\") pod \"ingress-canary-zg574\" (UID: \"40925518-6cf8-4a53-8691-1f2ba1620173\") " pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.997971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-config-volume\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x75sk\" (UniqueName: \"kubernetes.io/projected/40925518-6cf8-4a53-8691-1f2ba1620173-kube-api-access-x75sk\") pod \"ingress-canary-zg574\" (UID: \"40925518-6cf8-4a53-8691-1f2ba1620173\") " pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a310ac-d5de-4a56-b452-fa059e23e234-ca-trust-extracted\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-trusted-ca\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.998131    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.998146    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:34:41.998179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-installation-pull-secrets\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.998214    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:42.498195846 +0000 UTC m=+35.514988613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-tmp-dir\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.998261    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jk9b\" (UniqueName: \"kubernetes.io/projected/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-kube-api-access-2jk9b\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-image-registry-private-configuration\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:41.998316    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:42.498301457 +0000 UTC m=+35.515094224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-bound-sa-token\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-certificates\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.998639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a310ac-d5de-4a56-b452-fa059e23e234-ca-trust-extracted\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.999343 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-config-volume\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:41.999343 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.998934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-certificates\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.999343 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.999136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-trusted-ca\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:41.999343 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:41.999212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-tmp-dir\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:42.002606 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.002583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-image-registry-private-configuration\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:42.002606 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.002593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/40925518-6cf8-4a53-8691-1f2ba1620173-cert\") pod \"ingress-canary-zg574\" (UID: \"40925518-6cf8-4a53-8691-1f2ba1620173\") " pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:42.002755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.002589    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-installation-pull-secrets\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:42.009697 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.009671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jk9b\" (UniqueName: \"kubernetes.io/projected/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-kube-api-access-2jk9b\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:42.010820 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.010801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75sk\" (UniqueName: \"kubernetes.io/projected/40925518-6cf8-4a53-8691-1f2ba1620173-kube-api-access-x75sk\") pod \"ingress-canary-zg574\" (UID: \"40925518-6cf8-4a53-8691-1f2ba1620173\") " pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:42.020672 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.020651    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4mjh\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-kube-api-access-s4mjh\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:42.020794 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.020705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-bound-sa-token\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:42.097675 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.097636    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zg574"
Sep 08 11:34:42.501511 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.501475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:42.501953 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:42.501523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:42.501953 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:42.501644    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:34:42.501953 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:42.501663    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:34:42.501953 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:42.501688    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:34:42.501953 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:42.501697    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:43.50168385 +0000 UTC m=+36.518476628 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:34:42.501953 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:42.501756    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:43.501737086 +0000 UTC m=+36.518529867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:34:43.429421 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.429177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zg574"]
Sep 08 11:34:43.433763 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:34:43.433733    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40925518_6cf8_4a53_8691_1f2ba1620173.slice/crio-1b98d9681c71c9ae78045c164cc326ae182c2b5a4b438b42d84dcf3c372be46d WatchSource:0}: Error finding container 1b98d9681c71c9ae78045c164cc326ae182c2b5a4b438b42d84dcf3c372be46d: Status 404 returned error can't find the container with id 1b98d9681c71c9ae78045c164cc326ae182c2b5a4b438b42d84dcf3c372be46d
Sep 08 11:34:43.476917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.476840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:34:43.476917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.476861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:34:43.477083 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.476850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:34:43.480620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.480391    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kzc6v\""
Sep 08 11:34:43.480620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.480402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 11:34:43.480620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.480443    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 11:34:43.480620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.480391    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcrkc\""
Sep 08 11:34:43.480620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.480444    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 11:34:43.480620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.480402    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 11:34:43.510265 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.510233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:43.510655 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.510281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:43.510655 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:43.510407    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:34:43.510655 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:43.510410    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:34:43.510655 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:43.510433    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:34:43.510655 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:43.510473    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:45.510454618 +0000 UTC m=+38.527247384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:34:43.510655 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:43.510495    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:45.510483274 +0000 UTC m=+38.527276043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:34:43.679677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.679602    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerStarted","Data":"43ce61cb4e8d24b9e06ea0ad80fcf942a92615d7db2cfc2b95ed49f95922d164"}
Sep 08 11:34:43.680956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:43.680928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zg574" event={"ID":"40925518-6cf8-4a53-8691-1f2ba1620173","Type":"ContainerStarted","Data":"1b98d9681c71c9ae78045c164cc326ae182c2b5a4b438b42d84dcf3c372be46d"}
Sep 08 11:34:44.686986 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:44.686952    2577 generic.go:356] "Generic (PLEG): container finished" podID="23f5d473-3c46-4df6-8fe4-603d2bab0ac1" containerID="43ce61cb4e8d24b9e06ea0ad80fcf942a92615d7db2cfc2b95ed49f95922d164" exitCode=0
Sep 08 11:34:44.687644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:44.687020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerDied","Data":"43ce61cb4e8d24b9e06ea0ad80fcf942a92615d7db2cfc2b95ed49f95922d164"}
Sep 08 11:34:45.525989 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:45.525939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:45.525989 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:45.525995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:45.526237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:45.526098    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:34:45.526237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:45.526109    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:34:45.526237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:45.526131    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:34:45.526237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:45.526161    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:49.526147867 +0000 UTC m=+42.542940633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:34:45.526237 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:45.526184    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:49.526167826 +0000 UTC m=+42.542960594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:34:45.693819 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:45.693739    2577 generic.go:356] "Generic (PLEG): container finished" podID="23f5d473-3c46-4df6-8fe4-603d2bab0ac1" containerID="bd1494cc11f3c241343e08dd7417a40d8ffcdfe8278a1161535c99a3eceacf94" exitCode=0
Sep 08 11:34:45.693819 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:45.693789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerDied","Data":"bd1494cc11f3c241343e08dd7417a40d8ffcdfe8278a1161535c99a3eceacf94"}
Sep 08 11:34:46.697440 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:46.697403    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zg574" event={"ID":"40925518-6cf8-4a53-8691-1f2ba1620173","Type":"ContainerStarted","Data":"8183c9b12db2bd3725050bc9ed589226ae852204abb1aa42dec58d131c378003"}
Sep 08 11:34:46.700797 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:46.700770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" event={"ID":"23f5d473-3c46-4df6-8fe4-603d2bab0ac1","Type":"ContainerStarted","Data":"97ed74d319152aa62eb2286a0a16ceab971893929ac8169e51a458861197b4ce"}
Sep 08 11:34:46.713379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:46.713311    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zg574" podStartSLOduration=2.798222445 podStartE2EDuration="5.713292831s" totalImagesPullingTime="2.915070386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:46.713229756 +0000 UTC m=+39.730022543" watchObservedRunningTime="2026-09-08 11:34:46.713292831 +0000 UTC m=+39.730085620"
Sep 08 11:34:46.735764 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:46.735695    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8t7xn" podStartSLOduration=9.134906931 podStartE2EDuration="39.735672759s" totalImagesPullingTime="30.600765828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:34:46.735112507 +0000 UTC m=+39.751905297" watchObservedRunningTime="2026-09-08 11:34:46.735672759 +0000 UTC m=+39.752465549"
Sep 08 11:34:49.557446 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:49.557401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:49.557446 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:49.557449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:49.557962 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:49.557580    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:34:49.557962 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:49.557597    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:34:49.557962 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:49.557621    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:34:49.557962 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:49.557631    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:57.557617304 +0000 UTC m=+50.574410070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:34:49.557962 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:49.557676    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:34:57.55766087 +0000 UTC m=+50.574453653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:34:57.614845 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:57.614789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:34:57.614845 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:34:57.614853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:34:57.615349 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:57.614969    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:34:57.615349 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:57.615054    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.615037608 +0000 UTC m=+66.631830373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:34:57.615349 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:57.614972    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:34:57.615349 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:57.615083    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:34:57.615349 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:34:57.615134    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.615121082 +0000 UTC m=+66.631913862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:35:06.675180 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:06.675144    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv5lq"
Sep 08 11:35:06.956848 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:06.956768    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-ft2gk"]
Sep 08 11:35:06.965755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:06.965732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk"
Sep 08 11:35:06.968075 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:06.968052    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-89pqw\""
Sep 08 11:35:06.969382 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:06.969363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-ft2gk"]
Sep 08 11:35:07.061689 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.061656    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"]
Sep 08 11:35:07.063441 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.063419    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.065924 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.065906    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 11:35:07.066810 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.066786    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 11:35:07.067031 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.066807    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5vm2g\""
Sep 08 11:35:07.067031 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.066822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 11:35:07.067031 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.066861    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 11:35:07.077104 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.077080    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"]
Sep 08 11:35:07.082597 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.082573    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hgfx\" (UniqueName: \"kubernetes.io/projected/44a5c71d-edec-4bdd-a3d8-9579b4c797f0-kube-api-access-7hgfx\") pod \"network-check-source-685456655f-ft2gk\" (UID: \"44a5c71d-edec-4bdd-a3d8-9579b4c797f0\") " pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk"
Sep 08 11:35:07.183161 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.183122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pf4n\" (UniqueName: \"kubernetes.io/projected/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-kube-api-access-5pf4n\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.183348 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.183183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hgfx\" (UniqueName: \"kubernetes.io/projected/44a5c71d-edec-4bdd-a3d8-9579b4c797f0-kube-api-access-7hgfx\") pod \"network-check-source-685456655f-ft2gk\" (UID: \"44a5c71d-edec-4bdd-a3d8-9579b4c797f0\") " pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk"
Sep 08 11:35:07.183348 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.183211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.183348 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.183274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.204383 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.204348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hgfx\" (UniqueName: \"kubernetes.io/projected/44a5c71d-edec-4bdd-a3d8-9579b4c797f0-kube-api-access-7hgfx\") pod \"network-check-source-685456655f-ft2gk\" (UID: \"44a5c71d-edec-4bdd-a3d8-9579b4c797f0\") " pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk"
Sep 08 11:35:07.275559 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.275443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk"
Sep 08 11:35:07.283726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.283698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.283826 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.283757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pf4n\" (UniqueName: \"kubernetes.io/projected/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-kube-api-access-5pf4n\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.283826 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.283817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.283933 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:07.283875    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:07.283982 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:07.283955    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls podName:e24c4281-0d3d-4c5b-9092-8d362c5c40f2 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:07.783931368 +0000 UTC m=+60.800724348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bmtf5" (UID: "e24c4281-0d3d-4c5b-9092-8d362c5c40f2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:07.284759 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.284737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.292323 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.292289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pf4n\" (UniqueName: \"kubernetes.io/projected/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-kube-api-access-5pf4n\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.542830 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.542786    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-ft2gk"]
Sep 08 11:35:07.546351 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:07.546312    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a5c71d_edec_4bdd_a3d8_9579b4c797f0.slice/crio-dc70c3e8903b3a3fa4f499b8b864c9255283c89b81b68f6a61c47848823a2159 WatchSource:0}: Error finding container dc70c3e8903b3a3fa4f499b8b864c9255283c89b81b68f6a61c47848823a2159: Status 404 returned error can't find the container with id dc70c3e8903b3a3fa4f499b8b864c9255283c89b81b68f6a61c47848823a2159
Sep 08 11:35:07.749815 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.749780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk" event={"ID":"44a5c71d-edec-4bdd-a3d8-9579b4c797f0","Type":"ContainerStarted","Data":"dc70c3e8903b3a3fa4f499b8b864c9255283c89b81b68f6a61c47848823a2159"}
Sep 08 11:35:07.787392 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:07.787350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:07.787600 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:07.787499    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:07.787600 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:07.787587    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls podName:e24c4281-0d3d-4c5b-9092-8d362c5c40f2 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:08.787550535 +0000 UTC m=+61.804343301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bmtf5" (UID: "e24c4281-0d3d-4c5b-9092-8d362c5c40f2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:08.793352 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:08.793299    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:08.793785 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:08.793458    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:08.793785 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:08.793533    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls podName:e24c4281-0d3d-4c5b-9092-8d362c5c40f2 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:10.79351703 +0000 UTC m=+63.810309797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bmtf5" (UID: "e24c4281-0d3d-4c5b-9092-8d362c5c40f2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:10.810547 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:10.810504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:10.811033 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:10.810694    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:10.811033 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:10.810808    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls podName:e24c4281-0d3d-4c5b-9092-8d362c5c40f2 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:14.810785081 +0000 UTC m=+67.827577847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bmtf5" (UID: "e24c4281-0d3d-4c5b-9092-8d362c5c40f2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:11.760707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:11.760614    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk" event={"ID":"44a5c71d-edec-4bdd-a3d8-9579b4c797f0","Type":"ContainerStarted","Data":"e7e9e11a2f92a78be4a78e038ff3f6425f492e4f91296b0e4c255fd2513b1e3b"}
Sep 08 11:35:11.780015 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:11.779964    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-ft2gk" podStartSLOduration=1.970923457 podStartE2EDuration="5.779948265s" totalImagesPullingTime="3.809024808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:11.778939075 +0000 UTC m=+64.795731862" watchObservedRunningTime="2026-09-08 11:35:11.779948265 +0000 UTC m=+64.796741052"
Sep 08 11:35:12.160989 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.160950    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g24xd"]
Sep 08 11:35:12.162891 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.162874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.166765 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.166740    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 11:35:12.166947 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.166847    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 11:35:12.167015 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.166866    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5k58v\""
Sep 08 11:35:12.167503 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.167488    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 11:35:12.167581 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.167535    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 11:35:12.173997 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.173973    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g24xd"]
Sep 08 11:35:12.323858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.323823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e14eb257-e257-40db-a184-93b676a9f494-data-volume\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.323858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.323865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.324057 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.323888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.324140 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.324055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e14eb257-e257-40db-a184-93b676a9f494-crio-socket\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.324140 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.324098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pblk\" (UniqueName: \"kubernetes.io/projected/e14eb257-e257-40db-a184-93b676a9f494-kube-api-access-2pblk\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.424742 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.424648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e14eb257-e257-40db-a184-93b676a9f494-data-volume\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.424986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425084 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.425027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425148 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.425112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e14eb257-e257-40db-a184-93b676a9f494-crio-socket\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425148 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.425125    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:35:12.425148 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.425138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pblk\" (UniqueName: \"kubernetes.io/projected/e14eb257-e257-40db-a184-93b676a9f494-kube-api-access-2pblk\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425287 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.425224    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:12.925202834 +0000 UTC m=+65.941995619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : configmap "kube-rbac-proxy" not found
Sep 08 11:35:12.425287 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.425261    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e14eb257-e257-40db-a184-93b676a9f494-data-volume\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425287 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.425278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e14eb257-e257-40db-a184-93b676a9f494-crio-socket\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.425439 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.425283    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:12.425439 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.425365    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:12.925346705 +0000 UTC m=+65.942139480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:12.434413 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.434388    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pblk\" (UniqueName: \"kubernetes.io/projected/e14eb257-e257-40db-a184-93b676a9f494-kube-api-access-2pblk\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.928917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.928876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.928917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:12.928926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:12.929155 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.928955    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:35:12.929155 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.929023    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:12.929155 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.929037    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.929021344 +0000 UTC m=+66.945814110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : configmap "kube-rbac-proxy" not found
Sep 08 11:35:12.929155 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:12.929070    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:13.929059303 +0000 UTC m=+66.945852069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:13.230932 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.230831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:35:13.231316 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.230962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:35:13.232937 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.232917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 11:35:13.232989 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.232938    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 11:35:13.241200 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.241172    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 11:35:13.241339 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.241237    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs podName:07065e1e-cfb7-40f3-894d-c793ff6082c9 nodeName:}" failed. No retries permitted until 2026-09-08 11:36:17.241220954 +0000 UTC m=+130.258013724 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs") pod "network-metrics-daemon-rgtgk" (UID: "07065e1e-cfb7-40f3-894d-c793ff6082c9") : secret "metrics-daemon-secret" not found
Sep 08 11:35:13.243369 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.243341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40d06b34-232c-402a-95c0-ad2fdfd04e31-original-pull-secret\") pod \"global-pull-secret-syncer-5n8p5\" (UID: \"40d06b34-232c-402a-95c0-ad2fdfd04e31\") " pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:35:13.331783 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.331740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:35:13.334168 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.334148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr6tm\" (UniqueName: \"kubernetes.io/projected/aa1a0924-1237-4815-bef5-1163a4e27167-kube-api-access-kr6tm\") pod \"network-check-target-fxbt8\" (UID: \"aa1a0924-1237-4815-bef5-1163a4e27167\") " pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:35:13.490044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.489950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5n8p5"
Sep 08 11:35:13.500645 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.500611    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vcrkc\""
Sep 08 11:35:13.508537 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.508513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:35:13.634114 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.634075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:35:13.634282 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.634129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:35:13.634282 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.634234    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 11:35:13.634282 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.634248    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 11:35:13.634282 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.634270    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-598c48c5fb-7xrn5: secret "image-registry-tls" not found
Sep 08 11:35:13.634282 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.634284    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls podName:fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:45.634270626 +0000 UTC m=+98.651063392 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls") pod "dns-default-4kdd9" (UID: "fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0") : secret "dns-default-metrics-tls" not found
Sep 08 11:35:13.634491 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.634322    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls podName:f6a310ac-d5de-4a56-b452-fa059e23e234 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:45.634303786 +0000 UTC m=+98.651096572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls") pod "image-registry-598c48c5fb-7xrn5" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234") : secret "image-registry-tls" not found
Sep 08 11:35:13.781524 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.781493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5n8p5"]
Sep 08 11:35:13.784356 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:13.784326    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d06b34_232c_402a_95c0_ad2fdfd04e31.slice/crio-2c81b149a0cbb401806980a7dae5f0c21b7ad19bfc77a573e91bbe93579a74fd WatchSource:0}: Error finding container 2c81b149a0cbb401806980a7dae5f0c21b7ad19bfc77a573e91bbe93579a74fd: Status 404 returned error can't find the container with id 2c81b149a0cbb401806980a7dae5f0c21b7ad19bfc77a573e91bbe93579a74fd
Sep 08 11:35:13.807704 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.807676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fxbt8"]
Sep 08 11:35:13.810482 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:13.810453    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1a0924_1237_4815_bef5_1163a4e27167.slice/crio-858676a0f92098456d4e1758095a7859eab68782c45bc65aef9b2e25fd319530 WatchSource:0}: Error finding container 858676a0f92098456d4e1758095a7859eab68782c45bc65aef9b2e25fd319530: Status 404 returned error can't find the container with id 858676a0f92098456d4e1758095a7859eab68782c45bc65aef9b2e25fd319530
Sep 08 11:35:13.936090 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.936051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:13.936090 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:13.936088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:13.936313 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.936182    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:35:13.936313 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.936204    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:13.936313 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.936247    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:15.936235091 +0000 UTC m=+68.953027858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:13.936313 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:13.936262    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:15.936256143 +0000 UTC m=+68.953048909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : configmap "kube-rbac-proxy" not found
Sep 08 11:35:14.770830 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:14.770789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5n8p5" event={"ID":"40d06b34-232c-402a-95c0-ad2fdfd04e31","Type":"ContainerStarted","Data":"2c81b149a0cbb401806980a7dae5f0c21b7ad19bfc77a573e91bbe93579a74fd"}
Sep 08 11:35:14.773206 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:14.773176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fxbt8" event={"ID":"aa1a0924-1237-4815-bef5-1163a4e27167","Type":"ContainerStarted","Data":"ad96e3e88c543b494dc18f39636074d7d587ed3bdb5457d201735102a3b6d5a7"}
Sep 08 11:35:14.773356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:14.773226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fxbt8" event={"ID":"aa1a0924-1237-4815-bef5-1163a4e27167","Type":"ContainerStarted","Data":"858676a0f92098456d4e1758095a7859eab68782c45bc65aef9b2e25fd319530"}
Sep 08 11:35:14.773356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:14.773324    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:35:14.791078 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:14.791024    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fxbt8" podStartSLOduration=67.790998983 podStartE2EDuration="1m7.790998983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:14.789901527 +0000 UTC m=+67.806694315" watchObservedRunningTime="2026-09-08 11:35:14.790998983 +0000 UTC m=+67.807791772"
Sep 08 11:35:14.844049 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:14.844011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:14.844214 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:14.844189    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:14.844273 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:14.844257    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls podName:e24c4281-0d3d-4c5b-9092-8d362c5c40f2 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:22.844239868 +0000 UTC m=+75.861032635 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bmtf5" (UID: "e24c4281-0d3d-4c5b-9092-8d362c5c40f2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:15.140418 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:15.140385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s7bdl_0508f594-1ab3-46a7-9f2a-74b0cae0b4cc/dns-node-resolver/0.log"
Sep 08 11:35:15.939522 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:15.939490    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fntz6_ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb/node-ca/0.log"
Sep 08 11:35:15.955898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:15.955870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:15.956076 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:15.955907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:15.956076 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:15.955999    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:35:15.956076 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:15.956022    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:15.956076 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:15.956075    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:19.956055172 +0000 UTC m=+72.972847939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:15.956288 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:15.956093    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:19.956084342 +0000 UTC m=+72.972877108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : configmap "kube-rbac-proxy" not found
Sep 08 11:35:16.939867 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:16.939838    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zg574_40925518-6cf8-4a53-8691-1f2ba1620173/serve-healthcheck-canary/0.log"
Sep 08 11:35:17.783940 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:17.783634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5n8p5" event={"ID":"40d06b34-232c-402a-95c0-ad2fdfd04e31","Type":"ContainerStarted","Data":"e7f8826a4cec63368f2c9c0dbec3ba94eb03b37c60bd99dcf540f5842b465621"}
Sep 08 11:35:17.800250 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:17.800194    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5n8p5" podStartSLOduration=67.031234286 podStartE2EDuration="1m10.800178255s" totalImagesPullingTime="3.768943969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:17.799472387 +0000 UTC m=+70.816265174" watchObservedRunningTime="2026-09-08 11:35:17.800178255 +0000 UTC m=+70.816971043"
Sep 08 11:35:19.989630 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:19.989556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:19.989630 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:19.989643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:19.990122 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:19.989685    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 11:35:19.990122 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:19.989765    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:27.989743728 +0000 UTC m=+81.006536510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : configmap "kube-rbac-proxy" not found
Sep 08 11:35:19.990122 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:19.989788    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:19.990122 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:19.989834    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls podName:e14eb257-e257-40db-a184-93b676a9f494 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:27.989819256 +0000 UTC m=+81.006612036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g24xd" (UID: "e14eb257-e257-40db-a184-93b676a9f494") : secret "insights-runtime-extractor-tls" not found
Sep 08 11:35:22.914413 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:22.914364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:22.914862 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:22.914511    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:22.914862 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:22.914593    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls podName:e24c4281-0d3d-4c5b-9092-8d362c5c40f2 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:38.914577254 +0000 UTC m=+91.931370031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-bmtf5" (UID: "e24c4281-0d3d-4c5b-9092-8d362c5c40f2") : secret "cluster-monitoring-operator-tls" not found
Sep 08 11:35:28.055210 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.055162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:28.055210 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.055211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:28.055813 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.055790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e14eb257-e257-40db-a184-93b676a9f494-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:28.057598 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.057580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e14eb257-e257-40db-a184-93b676a9f494-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g24xd\" (UID: \"e14eb257-e257-40db-a184-93b676a9f494\") " pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:28.072612 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.072558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g24xd"
Sep 08 11:35:28.344840 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.344768    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g24xd"]
Sep 08 11:35:28.347858 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:28.347827    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14eb257_e257_40db_a184_93b676a9f494.slice/crio-3196aa465b84d2ca822427d08196eb21b8bcc10cdcbd5e51a8f302461d3bf91d WatchSource:0}: Error finding container 3196aa465b84d2ca822427d08196eb21b8bcc10cdcbd5e51a8f302461d3bf91d: Status 404 returned error can't find the container with id 3196aa465b84d2ca822427d08196eb21b8bcc10cdcbd5e51a8f302461d3bf91d
Sep 08 11:35:28.812817 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.812776    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g24xd" event={"ID":"e14eb257-e257-40db-a184-93b676a9f494","Type":"ContainerStarted","Data":"9937ce504bc75bd82b1f1e89924890c635d7beeae5011bfee98453aa124ae48d"}
Sep 08 11:35:28.812966 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:28.812835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g24xd" event={"ID":"e14eb257-e257-40db-a184-93b676a9f494","Type":"ContainerStarted","Data":"3196aa465b84d2ca822427d08196eb21b8bcc10cdcbd5e51a8f302461d3bf91d"}
Sep 08 11:35:29.817282 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:29.817248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g24xd" event={"ID":"e14eb257-e257-40db-a184-93b676a9f494","Type":"ContainerStarted","Data":"84fb7af189fa407ca594b34a724cc012709f0ed8f7faa85bd8308d013a6ad3b7"}
Sep 08 11:35:30.822349 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:30.822315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g24xd" event={"ID":"e14eb257-e257-40db-a184-93b676a9f494","Type":"ContainerStarted","Data":"8be6e0ae7623528198bd6da8931d45d5ad6d0e9e2d3a1d050a934d4150239b2d"}
Sep 08 11:35:30.843782 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:30.843728    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g24xd" podStartSLOduration=16.713811954 podStartE2EDuration="18.843712517s" totalImagesPullingTime="2.129900563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 11:35:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:30.843260187 +0000 UTC m=+83.860052977" watchObservedRunningTime="2026-09-08 11:35:30.843712517 +0000 UTC m=+83.860505305"
Sep 08 11:35:37.410433 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.410396    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-gfhvq"]
Sep 08 11:35:37.413522 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.413500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:37.416747 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.416722    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lck9h\""
Sep 08 11:35:37.416994 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.416977    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 11:35:37.417415 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.417397    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 11:35:37.421788 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.421767    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"]
Sep 08 11:35:37.424613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.424597    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.429338 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.428928    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 11:35:37.429338 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.429181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 11:35:37.430054 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.430022    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 11:35:37.430200 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.430184    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 11:35:37.455125 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.455095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"]
Sep 08 11:35:37.483602 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.483383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-gfhvq"]
Sep 08 11:35:37.522910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.522878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqzl\" (UniqueName: \"kubernetes.io/projected/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-kube-api-access-pnqzl\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.522910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.522918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-tmp\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.523169 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.523007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvt6d\" (UniqueName: \"kubernetes.io/projected/c46ba7e0-6b21-430a-86ac-2c5bf6b33a57-kube-api-access-pvt6d\") pod \"downloads-85d98c998f-gfhvq\" (UID: \"c46ba7e0-6b21-430a-86ac-2c5bf6b33a57\") " pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:37.523169 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.523093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.624357 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.624313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.624537 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.624373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqzl\" (UniqueName: \"kubernetes.io/projected/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-kube-api-access-pnqzl\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.624537 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.624392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-tmp\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.624537 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.624426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvt6d\" (UniqueName: \"kubernetes.io/projected/c46ba7e0-6b21-430a-86ac-2c5bf6b33a57-kube-api-access-pvt6d\") pod \"downloads-85d98c998f-gfhvq\" (UID: \"c46ba7e0-6b21-430a-86ac-2c5bf6b33a57\") " pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:37.624887 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.624864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-tmp\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.626817 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.626799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-klusterlet-config\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.634977 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.634948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqzl\" (UniqueName: \"kubernetes.io/projected/1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec-kube-api-access-pnqzl\") pod \"klusterlet-addon-workmgr-787868db46-9rz65\" (UID: \"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.636836 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.636819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvt6d\" (UniqueName: \"kubernetes.io/projected/c46ba7e0-6b21-430a-86ac-2c5bf6b33a57-kube-api-access-pvt6d\") pod \"downloads-85d98c998f-gfhvq\" (UID: \"c46ba7e0-6b21-430a-86ac-2c5bf6b33a57\") " pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:37.722430 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.722333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:37.737968 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.737942    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:37.995744 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:37.995660    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-gfhvq"]
Sep 08 11:35:37.999346 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:37.999315    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46ba7e0_6b21_430a_86ac_2c5bf6b33a57.slice/crio-cd60842c0eb6572165223b8790e9984d4b55a35d4e7a19c1a94de49dc75cfdb8 WatchSource:0}: Error finding container cd60842c0eb6572165223b8790e9984d4b55a35d4e7a19c1a94de49dc75cfdb8: Status 404 returned error can't find the container with id cd60842c0eb6572165223b8790e9984d4b55a35d4e7a19c1a94de49dc75cfdb8
Sep 08 11:35:38.013772 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:38.013746    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"]
Sep 08 11:35:38.016658 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:38.016633    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c02b43a_05f4_4bfe_b8e2_afd8e063e2ec.slice/crio-1951c3aa01a903d3609a7c4dc7440eddece022a444144bce0f5e733107385efd WatchSource:0}: Error finding container 1951c3aa01a903d3609a7c4dc7440eddece022a444144bce0f5e733107385efd: Status 404 returned error can't find the container with id 1951c3aa01a903d3609a7c4dc7440eddece022a444144bce0f5e733107385efd
Sep 08 11:35:38.851242 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:38.851198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65" event={"ID":"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec","Type":"ContainerStarted","Data":"1951c3aa01a903d3609a7c4dc7440eddece022a444144bce0f5e733107385efd"}
Sep 08 11:35:38.852455 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:38.852425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-gfhvq" event={"ID":"c46ba7e0-6b21-430a-86ac-2c5bf6b33a57","Type":"ContainerStarted","Data":"cd60842c0eb6572165223b8790e9984d4b55a35d4e7a19c1a94de49dc75cfdb8"}
Sep 08 11:35:38.934657 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:38.934616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:38.937518 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:38.937473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e24c4281-0d3d-4c5b-9092-8d362c5c40f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-bmtf5\" (UID: \"e24c4281-0d3d-4c5b-9092-8d362c5c40f2\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:39.174796 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:39.174705    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5vm2g\""
Sep 08 11:35:39.182550 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:39.182517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"
Sep 08 11:35:39.478213 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:39.478133    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5"]
Sep 08 11:35:39.483012 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:39.482981    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24c4281_0d3d_4c5b_9092_8d362c5c40f2.slice/crio-d8733633e992743e3125853e34f8d24f27dfc668b3f2f48017d6721a0e65ac3f WatchSource:0}: Error finding container d8733633e992743e3125853e34f8d24f27dfc668b3f2f48017d6721a0e65ac3f: Status 404 returned error can't find the container with id d8733633e992743e3125853e34f8d24f27dfc668b3f2f48017d6721a0e65ac3f
Sep 08 11:35:39.861892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:39.861852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5" event={"ID":"e24c4281-0d3d-4c5b-9092-8d362c5c40f2","Type":"ContainerStarted","Data":"d8733633e992743e3125853e34f8d24f27dfc668b3f2f48017d6721a0e65ac3f"}
Sep 08 11:35:42.429705 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.429522    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"]
Sep 08 11:35:42.432972 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.432945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:42.435273 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.435242    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 11:35:42.435406 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.435275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wnnqq\""
Sep 08 11:35:42.444003 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.443941    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"]
Sep 08 11:35:42.466637 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.466594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2267dfb0-814d-4e6b-827e-1c446d36f823-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-glt92\" (UID: \"2267dfb0-814d-4e6b-827e-1c446d36f823\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:42.521356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.521245    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649d487b9d-9klgn"]
Sep 08 11:35:42.525406 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.524595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.527259 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.527230    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-98z47\""
Sep 08 11:35:42.527429 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.527264    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 11:35:42.527533 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.527512    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 11:35:42.527613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.527583    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 11:35:42.527847 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.527807    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 11:35:42.527970 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.527911    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 11:35:42.537274 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.537246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649d487b9d-9klgn"]
Sep 08 11:35:42.567751 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.567713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l52f\" (UniqueName: \"kubernetes.io/projected/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-kube-api-access-7l52f\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.567917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.567853    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-serving-cert\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.567988 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.567912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2267dfb0-814d-4e6b-827e-1c446d36f823-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-glt92\" (UID: \"2267dfb0-814d-4e6b-827e-1c446d36f823\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:42.567988 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.567951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-service-ca\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.567988 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.567969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-oauth-serving-cert\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.568135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.567996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-oauth-config\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.568135 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.568017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-config\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.568135 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:42.568053    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 11:35:42.568273 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:35:42.568147    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2267dfb0-814d-4e6b-827e-1c446d36f823-tls-certificates podName:2267dfb0-814d-4e6b-827e-1c446d36f823 nodeName:}" failed. No retries permitted until 2026-09-08 11:35:43.068126413 +0000 UTC m=+96.084919193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2267dfb0-814d-4e6b-827e-1c446d36f823-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-glt92" (UID: "2267dfb0-814d-4e6b-827e-1c446d36f823") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 11:35:42.668487 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.668444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-oauth-config\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.668487 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.668488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-config\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.668758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.668541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l52f\" (UniqueName: \"kubernetes.io/projected/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-kube-api-access-7l52f\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.668758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.668620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-serving-cert\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.668758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.668676    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-service-ca\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.668758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.668696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-oauth-serving-cert\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.669552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.669503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-oauth-serving-cert\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.669716 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.669692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-service-ca\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.669867 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.669842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-config\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.672459 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.672430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-oauth-config\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.673005 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.672963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-serving-cert\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.677765 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.677743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l52f\" (UniqueName: \"kubernetes.io/projected/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-kube-api-access-7l52f\") pod \"console-649d487b9d-9klgn\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") " pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.837882 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.837842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:42.876578 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.876518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5" event={"ID":"e24c4281-0d3d-4c5b-9092-8d362c5c40f2","Type":"ContainerStarted","Data":"e983a6b6c8550bd6885a89e8d6b3f284380a85b081b8a06c35def97e54ede70d"}
Sep 08 11:35:42.896599 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:42.896520    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-bmtf5" podStartSLOduration=33.490119196 podStartE2EDuration="35.896497808s" totalImagesPullingTime="2.406378612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:42.895553617 +0000 UTC m=+95.912346406" watchObservedRunningTime="2026-09-08 11:35:42.896497808 +0000 UTC m=+95.913290596"
Sep 08 11:35:43.073011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.072972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2267dfb0-814d-4e6b-827e-1c446d36f823-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-glt92\" (UID: \"2267dfb0-814d-4e6b-827e-1c446d36f823\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:43.075927 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.075900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2267dfb0-814d-4e6b-827e-1c446d36f823-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-glt92\" (UID: \"2267dfb0-814d-4e6b-827e-1c446d36f823\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:43.345341 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.345060    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:43.882045 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.882001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65" event={"ID":"1c02b43a-05f4-4bfe-b8e2-afd8e063e2ec","Type":"ContainerStarted","Data":"34c3fcd3afecbe73818d68e3fe91a09841df61f987d64a49bcb589478fe1455f"}
Sep 08 11:35:43.882487 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.882202    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:43.884288 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.884259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65"
Sep 08 11:35:43.899502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.899378    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-787868db46-9rz65" podStartSLOduration=1.201724885 podStartE2EDuration="6.899362453s" totalImagesPullingTime="5.697637568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:43.89870348 +0000 UTC m=+96.915496269" watchObservedRunningTime="2026-09-08 11:35:43.899362453 +0000 UTC m=+96.916155240"
Sep 08 11:35:43.908107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.908081    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649d487b9d-9klgn"]
Sep 08 11:35:43.910908 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:43.910875    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c70774e_ce4a_4baf_a8fb_6c4488f16d84.slice/crio-360798c5b86106d25951e3b8f512b6c418a85a0b01f4ffd16c15329c557ebba3 WatchSource:0}: Error finding container 360798c5b86106d25951e3b8f512b6c418a85a0b01f4ffd16c15329c557ebba3: Status 404 returned error can't find the container with id 360798c5b86106d25951e3b8f512b6c418a85a0b01f4ffd16c15329c557ebba3
Sep 08 11:35:43.915147 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:43.915122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"]
Sep 08 11:35:43.918736 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:43.918699    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2267dfb0_814d_4e6b_827e_1c446d36f823.slice/crio-dd81a670ccfdcb2c8bda480b52e06c22212f2974aa1e5d4c9a08f2935dad6155 WatchSource:0}: Error finding container dd81a670ccfdcb2c8bda480b52e06c22212f2974aa1e5d4c9a08f2935dad6155: Status 404 returned error can't find the container with id dd81a670ccfdcb2c8bda480b52e06c22212f2974aa1e5d4c9a08f2935dad6155
Sep 08 11:35:44.888051 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:44.887964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d487b9d-9klgn" event={"ID":"0c70774e-ce4a-4baf-a8fb-6c4488f16d84","Type":"ContainerStarted","Data":"360798c5b86106d25951e3b8f512b6c418a85a0b01f4ffd16c15329c557ebba3"}
Sep 08 11:35:44.889518 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:44.889484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92" event={"ID":"2267dfb0-814d-4e6b-827e-1c446d36f823","Type":"ContainerStarted","Data":"dd81a670ccfdcb2c8bda480b52e06c22212f2974aa1e5d4c9a08f2935dad6155"}
Sep 08 11:35:45.695108 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.695019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:35:45.695285 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.695110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:35:45.697975 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.697945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0-metrics-tls\") pod \"dns-default-4kdd9\" (UID: \"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0\") " pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:35:45.698123 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.698012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"image-registry-598c48c5fb-7xrn5\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") " pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:35:45.778234 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.777900    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fxbt8"
Sep 08 11:35:45.896374 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.896304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92" event={"ID":"2267dfb0-814d-4e6b-827e-1c446d36f823","Type":"ContainerStarted","Data":"1c071685e579964bddfe17c38f8f69f612883c2b7997f209b8a905a1e107e65b"}
Sep 08 11:35:45.913292 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.912871    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92" podStartSLOduration=2.10473945 podStartE2EDuration="3.912847148s" totalImagesPullingTime="1.808107698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:45.91234212 +0000 UTC m=+98.929134908" watchObservedRunningTime="2026-09-08 11:35:45.912847148 +0000 UTC m=+98.929639937"
Sep 08 11:35:45.971165 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.971090    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-28gvn\""
Sep 08 11:35:45.979021 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.978986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:35:45.985483 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.985458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x9hjq\""
Sep 08 11:35:45.993393 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:45.993362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:35:46.900759 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:46.900725    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:46.906233 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:46.906202    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-glt92"
Sep 08 11:35:47.500783 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.500751    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"]
Sep 08 11:35:47.522632 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.522531    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"]
Sep 08 11:35:47.522805 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.522676    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.525068 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.525044    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 11:35:47.525170 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.525092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-vzrpj\""
Sep 08 11:35:47.525333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.525316    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 11:35:47.525798 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.525778    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 11:35:47.546496 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.546468    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4kdd9"]
Sep 08 11:35:47.551367 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.551342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-598c48c5fb-7xrn5"]
Sep 08 11:35:47.593903 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:47.593868    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4bb79c_3eff_4b6f_a4ef_30d0165ceae0.slice/crio-fa37ee0ceede78e1a37cf49f5dc8e0493cc2069cded22140101deb1cac6a657c WatchSource:0}: Error finding container fa37ee0ceede78e1a37cf49f5dc8e0493cc2069cded22140101deb1cac6a657c: Status 404 returned error can't find the container with id fa37ee0ceede78e1a37cf49f5dc8e0493cc2069cded22140101deb1cac6a657c
Sep 08 11:35:47.595684 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:47.595613    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a310ac_d5de_4a56_b452_fa059e23e234.slice/crio-12da376d1550965b2d9b849aeab07148077c1ebeba841832e8d6a148424afd40 WatchSource:0}: Error finding container 12da376d1550965b2d9b849aeab07148077c1ebeba841832e8d6a148424afd40: Status 404 returned error can't find the container with id 12da376d1550965b2d9b849aeab07148077c1ebeba841832e8d6a148424afd40
Sep 08 11:35:47.611513 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.611472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7af6a57-2753-47b6-9d75-fdb7e195db98-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.611665 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.611532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7af6a57-2753-47b6-9d75-fdb7e195db98-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.611665 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.611558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7af6a57-2753-47b6-9d75-fdb7e195db98-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.611665 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.611602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zzvx\" (UniqueName: \"kubernetes.io/projected/b7af6a57-2753-47b6-9d75-fdb7e195db98-kube-api-access-7zzvx\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.711965 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.711935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7af6a57-2753-47b6-9d75-fdb7e195db98-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.712090 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.711971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7af6a57-2753-47b6-9d75-fdb7e195db98-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.712090 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.711996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zzvx\" (UniqueName: \"kubernetes.io/projected/b7af6a57-2753-47b6-9d75-fdb7e195db98-kube-api-access-7zzvx\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.712090 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.712065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7af6a57-2753-47b6-9d75-fdb7e195db98-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.712899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.712875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7af6a57-2753-47b6-9d75-fdb7e195db98-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.714783 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.714758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7af6a57-2753-47b6-9d75-fdb7e195db98-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.714920 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.714898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7af6a57-2753-47b6-9d75-fdb7e195db98-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.720676 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.720652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zzvx\" (UniqueName: \"kubernetes.io/projected/b7af6a57-2753-47b6-9d75-fdb7e195db98-kube-api-access-7zzvx\") pod \"prometheus-operator-6f4946db56-cpfgb\" (UID: \"b7af6a57-2753-47b6-9d75-fdb7e195db98\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.834926 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.834886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"
Sep 08 11:35:47.907065 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.906993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5" event={"ID":"f6a310ac-d5de-4a56-b452-fa059e23e234","Type":"ContainerStarted","Data":"7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a"}
Sep 08 11:35:47.907834 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.907731    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:35:47.907834 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.907795    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5" event={"ID":"f6a310ac-d5de-4a56-b452-fa059e23e234","Type":"ContainerStarted","Data":"12da376d1550965b2d9b849aeab07148077c1ebeba841832e8d6a148424afd40"}
Sep 08 11:35:47.911741 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.911712    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d487b9d-9klgn" event={"ID":"0c70774e-ce4a-4baf-a8fb-6c4488f16d84","Type":"ContainerStarted","Data":"f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a"}
Sep 08 11:35:47.913814 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.913790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kdd9" event={"ID":"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0","Type":"ContainerStarted","Data":"fa37ee0ceede78e1a37cf49f5dc8e0493cc2069cded22140101deb1cac6a657c"}
Sep 08 11:35:47.929298 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.929243    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5" podStartSLOduration=99.929220664 podStartE2EDuration="1m39.929220664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:47.928178215 +0000 UTC m=+100.944971003" watchObservedRunningTime="2026-09-08 11:35:47.929220664 +0000 UTC m=+100.946013453"
Sep 08 11:35:47.948458 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:47.948406    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649d487b9d-9klgn" podStartSLOduration=2.236085748 podStartE2EDuration="5.948387994s" totalImagesPullingTime="3.712302246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:47.947417776 +0000 UTC m=+100.964210617" watchObservedRunningTime="2026-09-08 11:35:47.948387994 +0000 UTC m=+100.965180782"
Sep 08 11:35:48.135508 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:48.135415    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-cpfgb"]
Sep 08 11:35:48.138184 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:48.138156    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7af6a57_2753_47b6_9d75_fdb7e195db98.slice/crio-96a54d3d8aad101091ef897ed2a2b63338c06dbc89a2611679dd58a9b7bda015 WatchSource:0}: Error finding container 96a54d3d8aad101091ef897ed2a2b63338c06dbc89a2611679dd58a9b7bda015: Status 404 returned error can't find the container with id 96a54d3d8aad101091ef897ed2a2b63338c06dbc89a2611679dd58a9b7bda015
Sep 08 11:35:48.920110 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:48.920034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb" event={"ID":"b7af6a57-2753-47b6-9d75-fdb7e195db98","Type":"ContainerStarted","Data":"96a54d3d8aad101091ef897ed2a2b63338c06dbc89a2611679dd58a9b7bda015"}
Sep 08 11:35:50.307987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.307951    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67698d64bd-4xcjf"]
Sep 08 11:35:50.310129 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.310103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.317596 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.317556    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 11:35:50.320690 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.320653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67698d64bd-4xcjf"]
Sep 08 11:35:50.436800 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.436750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-oauth-config\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.436800 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.436792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-service-ca\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.437053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.436870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-serving-cert\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.437053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.436917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-trusted-ca-bundle\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.437053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.436972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj6mq\" (UniqueName: \"kubernetes.io/projected/8c7b0fe1-e912-41a9-af19-141dda7c6222-kube-api-access-pj6mq\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.437053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.437007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-config\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.437053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.437051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-oauth-serving-cert\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.537987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.537949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-oauth-serving-cert\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538188 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-oauth-config\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538188 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-service-ca\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538188 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-serving-cert\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538188 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-trusted-ca-bundle\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj6mq\" (UniqueName: \"kubernetes.io/projected/8c7b0fe1-e912-41a9-af19-141dda7c6222-kube-api-access-pj6mq\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538587 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-config\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-service-ca\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.538956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.538865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-oauth-serving-cert\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.539481 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.539432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-config\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.539612 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.539594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-trusted-ca-bundle\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.540730 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.540702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-oauth-config\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.541063 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.541043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-serving-cert\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.548054 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.548030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj6mq\" (UniqueName: \"kubernetes.io/projected/8c7b0fe1-e912-41a9-af19-141dda7c6222-kube-api-access-pj6mq\") pod \"console-67698d64bd-4xcjf\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") " pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:50.622026 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:50.621945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:35:52.838159 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:52.838115    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:52.838647 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:52.838222    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:52.843791 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:52.843765    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:52.939259 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:52.939228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:35:56.964177 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.964116    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-gfhvq" event={"ID":"c46ba7e0-6b21-430a-86ac-2c5bf6b33a57","Type":"ContainerStarted","Data":"ff83903809371ea21b268a6d6c37c63807f157e1766651faabc86d1b75a9bde3"}
Sep 08 11:35:56.964665 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.964357    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:56.966206 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.966126    2577 patch_prober.go:28] interesting pod/downloads-85d98c998f-gfhvq container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.12:8080/\": dial tcp 10.132.0.12:8080: connect: connection refused" start-of-body=
Sep 08 11:35:56.966340 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.966201    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-85d98c998f-gfhvq" podUID="c46ba7e0-6b21-430a-86ac-2c5bf6b33a57" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.12:8080/\": dial tcp 10.132.0.12:8080: connect: connection refused"
Sep 08 11:35:56.968359 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.967411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb" event={"ID":"b7af6a57-2753-47b6-9d75-fdb7e195db98","Type":"ContainerStarted","Data":"96c4256b5c86a8c950f7a100ee290e94f2538be366dc53934c6f23d58926139f"}
Sep 08 11:35:56.968359 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.967461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb" event={"ID":"b7af6a57-2753-47b6-9d75-fdb7e195db98","Type":"ContainerStarted","Data":"3b8bfb9aeb1f1677dad7b9842f750c8e33425654003b09916686ec06e4b09474"}
Sep 08 11:35:56.970687 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.970599    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kdd9" event={"ID":"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0","Type":"ContainerStarted","Data":"10eb1ef90dac826744f442d743511468466cd93311d397beb1c090f869ec532f"}
Sep 08 11:35:56.996168 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:56.995591    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-gfhvq" podStartSLOduration=1.19590788 podStartE2EDuration="19.995550427s" totalImagesPullingTime="18.799642547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:56.992274563 +0000 UTC m=+110.009067352" watchObservedRunningTime="2026-09-08 11:35:56.995550427 +0000 UTC m=+110.012343216"
Sep 08 11:35:57.014422 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.014369    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-cpfgb" podStartSLOduration=1.35333616 podStartE2EDuration="10.014352843s" totalImagesPullingTime="8.661016683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:57.01248006 +0000 UTC m=+110.029272840" watchObservedRunningTime="2026-09-08 11:35:57.014352843 +0000 UTC m=+110.031145630"
Sep 08 11:35:57.076802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.076724    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67698d64bd-4xcjf"]
Sep 08 11:35:57.081585 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:57.081531    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7b0fe1_e912_41a9_af19_141dda7c6222.slice/crio-0b6f448c86cb2e026bb12998199f49f0811727a1d9e43f63e0d4f0eeb3443fd8 WatchSource:0}: Error finding container 0b6f448c86cb2e026bb12998199f49f0811727a1d9e43f63e0d4f0eeb3443fd8: Status 404 returned error can't find the container with id 0b6f448c86cb2e026bb12998199f49f0811727a1d9e43f63e0d4f0eeb3443fd8
Sep 08 11:35:57.977977 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.977939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67698d64bd-4xcjf" event={"ID":"8c7b0fe1-e912-41a9-af19-141dda7c6222","Type":"ContainerStarted","Data":"9bb135b56323c95668cc82d233827fc525733b126df0c8f82424a791819fddab"}
Sep 08 11:35:57.978478 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.978003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67698d64bd-4xcjf" event={"ID":"8c7b0fe1-e912-41a9-af19-141dda7c6222","Type":"ContainerStarted","Data":"0b6f448c86cb2e026bb12998199f49f0811727a1d9e43f63e0d4f0eeb3443fd8"}
Sep 08 11:35:57.980353 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.980321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kdd9" event={"ID":"fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0","Type":"ContainerStarted","Data":"4d91608d0108124aa22a11cc1aeaa780987040d9cb866ebe92f2df8e5830e02e"}
Sep 08 11:35:57.980500 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.980401    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:35:57.985074 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:57.985045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-gfhvq"
Sep 08 11:35:58.000702 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.000639    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67698d64bd-4xcjf" podStartSLOduration=8.00062102 podStartE2EDuration="8.00062102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:57.999666949 +0000 UTC m=+111.016459738" watchObservedRunningTime="2026-09-08 11:35:58.00062102 +0000 UTC m=+111.017413809"
Sep 08 11:35:58.023139 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.023083    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4kdd9" podStartSLOduration=67.837439826 podStartE2EDuration="1m17.023061733s" totalImagesPullingTime="9.185621907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:34:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:35:58.022355204 +0000 UTC m=+111.039147994" watchObservedRunningTime="2026-09-08 11:35:58.023061733 +0000 UTC m=+111.039854725"
Sep 08 11:35:58.908948 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.908909    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"]
Sep 08 11:35:58.927833 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.927803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:58.929666 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.929628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"]
Sep 08 11:35:58.930814 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.930784    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 11:35:58.931414 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.931387    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 11:35:58.931524 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.931435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rs6fj\""
Sep 08 11:35:58.942541 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.942515    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t57zj"]
Sep 08 11:35:58.967171 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.967104    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:58.970026 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.969999    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 11:35:58.970823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.970799    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 11:35:58.970939 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.970865    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 11:35:58.971756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:58.971722    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-49vgw\""
Sep 08 11:35:59.015423 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.015385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7426cb43-e48f-4ce9-92b4-e2e5361244a9-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.015901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.015430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh28n\" (UniqueName: \"kubernetes.io/projected/7426cb43-e48f-4ce9-92b4-e2e5361244a9-kube-api-access-xh28n\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.015901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.015591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7426cb43-e48f-4ce9-92b4-e2e5361244a9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.015901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.015633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7426cb43-e48f-4ce9-92b4-e2e5361244a9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.116927 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.116878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117292 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117265    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7426cb43-e48f-4ce9-92b4-e2e5361244a9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.117432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-wtmp\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-tls\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7426cb43-e48f-4ce9-92b4-e2e5361244a9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.117659 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-textfile\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117659 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-metrics-client-ca\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117659 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flbc8\" (UniqueName: \"kubernetes.io/projected/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-kube-api-access-flbc8\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117659 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7426cb43-e48f-4ce9-92b4-e2e5361244a9-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.117856 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117667    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-root\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.117856 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh28n\" (UniqueName: \"kubernetes.io/projected/7426cb43-e48f-4ce9-92b4-e2e5361244a9-kube-api-access-xh28n\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.117856 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.117736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-sys\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.118577 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.118538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7426cb43-e48f-4ce9-92b4-e2e5361244a9-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.120170 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.120142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7426cb43-e48f-4ce9-92b4-e2e5361244a9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.120269 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.120244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7426cb43-e48f-4ce9-92b4-e2e5361244a9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.127485 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.127458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh28n\" (UniqueName: \"kubernetes.io/projected/7426cb43-e48f-4ce9-92b4-e2e5361244a9-kube-api-access-xh28n\") pod \"openshift-state-metrics-657fd6c54-fbnsf\" (UID: \"7426cb43-e48f-4ce9-92b4-e2e5361244a9\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.218957 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.218863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-metrics-client-ca\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.218957 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.218915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flbc8\" (UniqueName: \"kubernetes.io/projected/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-kube-api-access-flbc8\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.218957 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.218945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-root\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.218966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-sys\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-wtmp\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-sys\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-tls\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-textfile\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219608 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-wtmp\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219608 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-textfile\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219608 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219067    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-root\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219608 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-metrics-client-ca\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.219993 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.219962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.221790 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.221764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.221790 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.221777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-node-exporter-tls\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.230226 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.230196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flbc8\" (UniqueName: \"kubernetes.io/projected/0696a996-79d5-4d1e-aebb-b4ffb37fde6e-kube-api-access-flbc8\") pod \"node-exporter-t57zj\" (UID: \"0696a996-79d5-4d1e-aebb-b4ffb37fde6e\") " pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.241093 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.241053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"
Sep 08 11:35:59.278460 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.278432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t57zj"
Sep 08 11:35:59.306398 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:59.306362    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0696a996_79d5_4d1e_aebb_b4ffb37fde6e.slice/crio-adfdb18795b30832cda41b05ee8f94f558032603b7b24d3ac6c07e3e89a1c3ac WatchSource:0}: Error finding container adfdb18795b30832cda41b05ee8f94f558032603b7b24d3ac6c07e3e89a1c3ac: Status 404 returned error can't find the container with id adfdb18795b30832cda41b05ee8f94f558032603b7b24d3ac6c07e3e89a1c3ac
Sep 08 11:35:59.553052 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.553020    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf"]
Sep 08 11:35:59.555802 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:35:59.555773    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7426cb43_e48f_4ce9_92b4_e2e5361244a9.slice/crio-c9a0548aa5375fa16901fcab9b9014ff77b4122921dba0afd3d5dbb2b2055813 WatchSource:0}: Error finding container c9a0548aa5375fa16901fcab9b9014ff77b4122921dba0afd3d5dbb2b2055813: Status 404 returned error can't find the container with id c9a0548aa5375fa16901fcab9b9014ff77b4122921dba0afd3d5dbb2b2055813
Sep 08 11:35:59.799968 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.799928    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-598c48c5fb-7xrn5"]
Sep 08 11:35:59.991937 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.991834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t57zj" event={"ID":"0696a996-79d5-4d1e-aebb-b4ffb37fde6e","Type":"ContainerStarted","Data":"adfdb18795b30832cda41b05ee8f94f558032603b7b24d3ac6c07e3e89a1c3ac"}
Sep 08 11:35:59.996787 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.996751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf" event={"ID":"7426cb43-e48f-4ce9-92b4-e2e5361244a9","Type":"ContainerStarted","Data":"6aedffd7254a49d1865cf715f604c82488f612003022ca6e644838e974fcfa8f"}
Sep 08 11:35:59.997018 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.996822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf" event={"ID":"7426cb43-e48f-4ce9-92b4-e2e5361244a9","Type":"ContainerStarted","Data":"d3f3645492141e4825036bc40cd880c8b1a706aa5a7062fc79f1e2066b393efb"}
Sep 08 11:35:59.997018 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:35:59.996850    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf" event={"ID":"7426cb43-e48f-4ce9-92b4-e2e5361244a9","Type":"ContainerStarted","Data":"c9a0548aa5375fa16901fcab9b9014ff77b4122921dba0afd3d5dbb2b2055813"}
Sep 08 11:36:00.623170 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:00.623011    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:36:00.623768 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:00.623744    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:36:00.629095 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:00.629073    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:36:01.006206 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:01.006117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:36:01.066413 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:01.066379    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649d487b9d-9klgn"]
Sep 08 11:36:02.008168 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:02.008085    2577 generic.go:356] "Generic (PLEG): container finished" podID="0696a996-79d5-4d1e-aebb-b4ffb37fde6e" containerID="48b19d446142b11f528e1f1032dc0132645872226bb893c36c13a169e1867eb0" exitCode=0
Sep 08 11:36:02.008648 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:02.008173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t57zj" event={"ID":"0696a996-79d5-4d1e-aebb-b4ffb37fde6e","Type":"ContainerDied","Data":"48b19d446142b11f528e1f1032dc0132645872226bb893c36c13a169e1867eb0"}
Sep 08 11:36:02.010964 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:02.010937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf" event={"ID":"7426cb43-e48f-4ce9-92b4-e2e5361244a9","Type":"ContainerStarted","Data":"b20916d3834653a52dc441098aaa004d7f29e7f332be50e27aec8541d0369d42"}
Sep 08 11:36:02.053448 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:02.053395    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-fbnsf" podStartSLOduration=2.1897437220000002 podStartE2EDuration="4.053371107s" totalImagesPullingTime="1.863627385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:02.051249407 +0000 UTC m=+115.068042197" watchObservedRunningTime="2026-09-08 11:36:02.053371107 +0000 UTC m=+115.070163894"
Sep 08 11:36:03.018203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.018159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t57zj" event={"ID":"0696a996-79d5-4d1e-aebb-b4ffb37fde6e","Type":"ContainerStarted","Data":"65e67b66768b679304da27af0ce8a801c9f542cd3cd9745c4dfa6f3a81dad5d2"}
Sep 08 11:36:03.018811 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.018233    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t57zj" event={"ID":"0696a996-79d5-4d1e-aebb-b4ffb37fde6e","Type":"ContainerStarted","Data":"d5bf25b5a19944b4f0b7fdd11596470ccb5eea4d3c5d0d25a7cd172b4a1934e0"}
Sep 08 11:36:03.053166 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.053107    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t57zj" podStartSLOduration=2.884407997 podStartE2EDuration="5.053090484s" totalImagesPullingTime="2.090051251s" totalInitContainerRuntime="78.631236ms" isStatefulPod=true podCreationTimestamp="2026-09-08 11:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:03.051672804 +0000 UTC m=+116.068465593" watchObservedRunningTime="2026-09-08 11:36:03.053090484 +0000 UTC m=+116.069883269"
Sep 08 11:36:03.711510 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.711477    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"]
Sep 08 11:36:03.740957 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.740926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"]
Sep 08 11:36:03.741120 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.741057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:03.745042 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.744895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 11:36:03.745042 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.744900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bcj2d\""
Sep 08 11:36:03.866733 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.866694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5hw4\" (UniqueName: \"kubernetes.io/projected/664bef1b-4d50-4c24-bee8-667e1e5cb41a-kube-api-access-w5hw4\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:03.866930 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.866809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/664bef1b-4d50-4c24-bee8-667e1e5cb41a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:03.967886 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.967788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5hw4\" (UniqueName: \"kubernetes.io/projected/664bef1b-4d50-4c24-bee8-667e1e5cb41a-kube-api-access-w5hw4\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:03.967886 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.967865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/664bef1b-4d50-4c24-bee8-667e1e5cb41a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:03.968110 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:36:03.968006    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 08 11:36:03.968110 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:36:03.968077    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/664bef1b-4d50-4c24-bee8-667e1e5cb41a-monitoring-plugin-cert podName:664bef1b-4d50-4c24-bee8-667e1e5cb41a nodeName:}" failed. No retries permitted until 2026-09-08 11:36:04.468056033 +0000 UTC m=+117.484848802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/664bef1b-4d50-4c24-bee8-667e1e5cb41a-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-x2vhl" (UID: "664bef1b-4d50-4c24-bee8-667e1e5cb41a") : secret "monitoring-plugin-cert" not found
Sep 08 11:36:03.979690 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:03.979663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5hw4\" (UniqueName: \"kubernetes.io/projected/664bef1b-4d50-4c24-bee8-667e1e5cb41a-kube-api-access-w5hw4\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:04.151039 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.151000    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f586b4db-pzc9f"]
Sep 08 11:36:04.176927 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.176891    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f586b4db-pzc9f"]
Sep 08 11:36:04.177102 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.177031    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.179798 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.179771    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 11:36:04.180042 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.180018    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 11:36:04.180465 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.180442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 11:36:04.180743 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.180722    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 11:36:04.180851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.180791    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 11:36:04.180920 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.180895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cvhzq\""
Sep 08 11:36:04.187154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.187132    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 11:36:04.271053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.270964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-serving-certs-ca-bundle\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-telemeter-client-tls\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271247 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271247 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-metrics-client-ca\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271247 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nzbq\" (UniqueName: \"kubernetes.io/projected/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-kube-api-access-7nzbq\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271373 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-federate-client-tls\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271373 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.271444 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.271390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-secret-telemeter-client\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.372682 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.372637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-metrics-client-ca\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.372874 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.372690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nzbq\" (UniqueName: \"kubernetes.io/projected/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-kube-api-access-7nzbq\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.372874 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.372733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-federate-client-tls\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.372874 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.372766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.373207 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.373174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-secret-telemeter-client\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.373312 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.373224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-serving-certs-ca-bundle\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.373312 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.373252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-telemeter-client-tls\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.373312 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.373285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.373492 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.373462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-metrics-client-ca\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.374106 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.374078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-serving-certs-ca-bundle\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.374209 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.374091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.375890 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.375801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.375977 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.375910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-secret-telemeter-client\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.375977 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.375959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-federate-client-tls\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.376158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.376132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-telemeter-client-tls\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.382336 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.382312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nzbq\" (UniqueName: \"kubernetes.io/projected/7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2-kube-api-access-7nzbq\") pod \"telemeter-client-6f586b4db-pzc9f\" (UID: \"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2\") " pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.474672 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.474631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/664bef1b-4d50-4c24-bee8-667e1e5cb41a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:04.477534 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.477488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/664bef1b-4d50-4c24-bee8-667e1e5cb41a-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-x2vhl\" (UID: \"664bef1b-4d50-4c24-bee8-667e1e5cb41a\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:04.489577 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.489538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f"
Sep 08 11:36:04.652834 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.652791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:04.817381 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.817283    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f586b4db-pzc9f"]
Sep 08 11:36:04.822877 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:36:04.820320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1d7bc5_fc4e_4f13_a314_bc8a2b87a2a2.slice/crio-45e1b85634b486f8363afe1591bfd92564c96f624e2439b1643e4bf2313f6c96 WatchSource:0}: Error finding container 45e1b85634b486f8363afe1591bfd92564c96f624e2439b1643e4bf2313f6c96: Status 404 returned error can't find the container with id 45e1b85634b486f8363afe1591bfd92564c96f624e2439b1643e4bf2313f6c96
Sep 08 11:36:04.961211 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:04.961175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"]
Sep 08 11:36:04.964605 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:36:04.964551    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664bef1b_4d50_4c24_bee8_667e1e5cb41a.slice/crio-9389dbb6c16c5a8895c0049b6783fda6cb82953807b6acf21f8fee26474a83d9 WatchSource:0}: Error finding container 9389dbb6c16c5a8895c0049b6783fda6cb82953807b6acf21f8fee26474a83d9: Status 404 returned error can't find the container with id 9389dbb6c16c5a8895c0049b6783fda6cb82953807b6acf21f8fee26474a83d9
Sep 08 11:36:05.028838 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.028794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl" event={"ID":"664bef1b-4d50-4c24-bee8-667e1e5cb41a","Type":"ContainerStarted","Data":"9389dbb6c16c5a8895c0049b6783fda6cb82953807b6acf21f8fee26474a83d9"}
Sep 08 11:36:05.030504 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.030470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f" event={"ID":"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2","Type":"ContainerStarted","Data":"45e1b85634b486f8363afe1591bfd92564c96f624e2439b1643e4bf2313f6c96"}
Sep 08 11:36:05.217670 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.217582    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:36:05.244161 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.244121    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.244621 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.244592    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.247668    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.247656    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-68mkd\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.247704    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.247790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.247918    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248026    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248045    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248133    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 11:36:05.248356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248254    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 11:36:05.248951 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248385    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 11:36:05.248951 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 11:36:05.248951 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248644    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 11:36:05.248951 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.248769    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 11:36:05.249439 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.249412    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-45ibie7uvjccj\""
Sep 08 11:36:05.253590 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.252388    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 11:36:05.254931 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.254908    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 11:36:05.383680 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-config\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.383881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.383973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.384129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.384184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384280 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.384211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74ng\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-kube-api-access-b74ng\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.384288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.384315    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.384677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.384340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74ng\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-kube-api-access-b74ng\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-config\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.486158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.488754 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.488754 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.488754 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.488754 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.485713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.495050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.491465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.495050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.492087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.495050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.493207    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.495050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.493855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.495050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.494446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.502546 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.501764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.502546 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.502240    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.508880 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.507773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.508880 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.508150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.508880 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.508524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-config\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.508880 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.508843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.510621 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.510602    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-web-config\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.511157 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.511114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.513548 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.512508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.513548 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.513099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74ng\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-kube-api-access-b74ng\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.513548 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.513513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.514353 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.513951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-config-out\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.514353 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.514309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.515531 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.515509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.559933 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.559669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:05.892973 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:05.892941    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:36:05.896735 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:36:05.896695    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c64487e_f840_4c11_a46d_91d58613a13a.slice/crio-b1d9d3aff1c34c91ffe317e644204b2f27908b18f513c8090737c84c61b49642 WatchSource:0}: Error finding container b1d9d3aff1c34c91ffe317e644204b2f27908b18f513c8090737c84c61b49642: Status 404 returned error can't find the container with id b1d9d3aff1c34c91ffe317e644204b2f27908b18f513c8090737c84c61b49642
Sep 08 11:36:06.037188 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:06.037146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"b1d9d3aff1c34c91ffe317e644204b2f27908b18f513c8090737c84c61b49642"}
Sep 08 11:36:07.987550 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:07.987521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4kdd9"
Sep 08 11:36:09.050613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.050583    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7" exitCode=0
Sep 08 11:36:09.051031 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.050661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"}
Sep 08 11:36:09.053065 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.053041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f" event={"ID":"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2","Type":"ContainerStarted","Data":"2f795d08986d000384d5c38c514803eb805ab0d393f2600db41e18dba45fa1a8"}
Sep 08 11:36:09.053178 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.053089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f" event={"ID":"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2","Type":"ContainerStarted","Data":"eb722167b193dce05a0002f77f455c1525c555f84ea3ba4c52daf2ffebea89df"}
Sep 08 11:36:09.053178 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.053108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f" event={"ID":"7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2","Type":"ContainerStarted","Data":"686ee58388083c73efe22fe615b6d1af0207848da366b6f75f41e19db075b91e"}
Sep 08 11:36:09.054577 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.054540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl" event={"ID":"664bef1b-4d50-4c24-bee8-667e1e5cb41a","Type":"ContainerStarted","Data":"e5d83a363935b8c3ed2698e72d1563896e740d509f62d7c715ed8787b515659e"}
Sep 08 11:36:09.054769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.054755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:09.059689 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.059673    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl"
Sep 08 11:36:09.094296 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.094246    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-x2vhl" podStartSLOduration=3.077380367 podStartE2EDuration="6.094230491s" totalImagesPullingTime="3.016850124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:09.093485681 +0000 UTC m=+122.110278469" watchObservedRunningTime="2026-09-08 11:36:09.094230491 +0000 UTC m=+122.111023278"
Sep 08 11:36:09.119572 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.119508    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f586b4db-pzc9f" podStartSLOduration=1.294115769 podStartE2EDuration="5.119490804s" totalImagesPullingTime="3.825375035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:09.117353602 +0000 UTC m=+122.134146391" watchObservedRunningTime="2026-09-08 11:36:09.119490804 +0000 UTC m=+122.136283592"
Sep 08 11:36:09.806648 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:09.806618    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:36:13.077669 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:13.077629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"}
Sep 08 11:36:13.078042 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:13.077697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"}
Sep 08 11:36:16.094463 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:16.094426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"}
Sep 08 11:36:16.094917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:16.094492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"}
Sep 08 11:36:16.094917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:16.094525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"}
Sep 08 11:36:16.094917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:16.094554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerStarted","Data":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"}
Sep 08 11:36:16.130873 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:16.130825    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.491829879 podStartE2EDuration="11.130791542s" totalImagesPullingTime="8.613584934s" totalInitContainerRuntime="25.376729ms" isStatefulPod=false podCreationTimestamp="2026-09-08 11:36:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:16.128774138 +0000 UTC m=+129.145566927" watchObservedRunningTime="2026-09-08 11:36:16.130791542 +0000 UTC m=+129.147584329"
Sep 08 11:36:17.290270 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:17.290231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:36:17.292549 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:17.292526    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07065e1e-cfb7-40f3-894d-c793ff6082c9-metrics-certs\") pod \"network-metrics-daemon-rgtgk\" (UID: \"07065e1e-cfb7-40f3-894d-c793ff6082c9\") " pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:36:17.406326 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:17.406290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kzc6v\""
Sep 08 11:36:17.414010 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:17.413987    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rgtgk"
Sep 08 11:36:17.711205 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:17.711129    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rgtgk"]
Sep 08 11:36:17.714872 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:36:17.714847    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07065e1e_cfb7_40f3_894d_c793ff6082c9.slice/crio-9ee7b394a1d996643c6f1e423dde0969fa24c3c8cb95001e0fb4f2e407acab93 WatchSource:0}: Error finding container 9ee7b394a1d996643c6f1e423dde0969fa24c3c8cb95001e0fb4f2e407acab93: Status 404 returned error can't find the container with id 9ee7b394a1d996643c6f1e423dde0969fa24c3c8cb95001e0fb4f2e407acab93
Sep 08 11:36:18.102706 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:18.102665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgtgk" event={"ID":"07065e1e-cfb7-40f3-894d-c793ff6082c9","Type":"ContainerStarted","Data":"9ee7b394a1d996643c6f1e423dde0969fa24c3c8cb95001e0fb4f2e407acab93"}
Sep 08 11:36:19.972896 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:19.972864    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67698d64bd-4xcjf"]
Sep 08 11:36:20.112169 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:20.112134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgtgk" event={"ID":"07065e1e-cfb7-40f3-894d-c793ff6082c9","Type":"ContainerStarted","Data":"f4c21ae9c58e772d01a9166f3606ed6321b56a7ef9e36c1ba0055baee86a8f00"}
Sep 08 11:36:20.112411 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:20.112191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rgtgk" event={"ID":"07065e1e-cfb7-40f3-894d-c793ff6082c9","Type":"ContainerStarted","Data":"8b75454304c460a137a30cf4eeeeea8a7ae60798223dbbdb8a00a524a99e61a0"}
Sep 08 11:36:20.128878 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:20.128822    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rgtgk" podStartSLOduration=131.653774766 podStartE2EDuration="2m13.128805537s" totalImagesPullingTime="1.475030771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:36:20.128468198 +0000 UTC m=+133.145260986" watchObservedRunningTime="2026-09-08 11:36:20.128805537 +0000 UTC m=+133.145598325"
Sep 08 11:36:20.561261 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:20.561220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:36:24.824071 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:24.824005    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5" podUID="f6a310ac-d5de-4a56-b452-fa059e23e234" containerName="registry" containerID="cri-o://7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a" gracePeriod=30
Sep 08 11:36:25.091723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.091648    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:36:25.137122 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.137088    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6a310ac-d5de-4a56-b452-fa059e23e234" containerID="7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a" exitCode=0
Sep 08 11:36:25.137294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.137135    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5"
Sep 08 11:36:25.137294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.137171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5" event={"ID":"f6a310ac-d5de-4a56-b452-fa059e23e234","Type":"ContainerDied","Data":"7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a"}
Sep 08 11:36:25.137294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.137220    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-598c48c5fb-7xrn5" event={"ID":"f6a310ac-d5de-4a56-b452-fa059e23e234","Type":"ContainerDied","Data":"12da376d1550965b2d9b849aeab07148077c1ebeba841832e8d6a148424afd40"}
Sep 08 11:36:25.137294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.137244    2577 scope.go:117] "RemoveContainer" containerID="7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a"
Sep 08 11:36:25.145395 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.145378    2577 scope.go:117] "RemoveContainer" containerID="7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a"
Sep 08 11:36:25.145701 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:36:25.145681    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a\": container with ID starting with 7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a not found: ID does not exist" containerID="7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a"
Sep 08 11:36:25.145759 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.145712    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a"} err="failed to get container status \"7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a\": rpc error: code = NotFound desc = could not find container \"7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a\": container with ID starting with 7d359160a3c49cd4681aa7f73e6c39fcd8a6883e54f88d24a5de4d77d729706a not found: ID does not exist"
Sep 08 11:36:25.157034 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a310ac-d5de-4a56-b452-fa059e23e234-ca-trust-extracted\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157132 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157044    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157132 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157078    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4mjh\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-kube-api-access-s4mjh\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157132 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-installation-pull-secrets\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157283 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-trusted-ca\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157283 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157168    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-image-registry-private-configuration\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157283 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-certificates\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157283 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157260    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-bound-sa-token\") pod \"f6a310ac-d5de-4a56-b452-fa059e23e234\" (UID: \"f6a310ac-d5de-4a56-b452-fa059e23e234\") "
Sep 08 11:36:25.157693 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157635    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:25.158011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.157984    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:25.160150 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.160121    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:36:25.160150 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.160136    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:36:25.160297 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.160176    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-kube-api-access-s4mjh" (OuterVolumeSpecName: "kube-api-access-s4mjh") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "kube-api-access-s4mjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:36:25.160297 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.160212    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:36:25.160378 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.160364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:36:25.165930 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.165906    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6a310ac-d5de-4a56-b452-fa059e23e234-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f6a310ac-d5de-4a56-b452-fa059e23e234" (UID: "f6a310ac-d5de-4a56-b452-fa059e23e234"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:36:25.258583 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258528    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-certificates\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258583 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258580    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-bound-sa-token\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258583 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258593    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6a310ac-d5de-4a56-b452-fa059e23e234-ca-trust-extracted\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258816 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258602    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258816 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258613    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4mjh\" (UniqueName: \"kubernetes.io/projected/f6a310ac-d5de-4a56-b452-fa059e23e234-kube-api-access-s4mjh\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258816 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258620    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-installation-pull-secrets\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258816 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258629    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6a310ac-d5de-4a56-b452-fa059e23e234-trusted-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.258816 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.258637    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6a310ac-d5de-4a56-b452-fa059e23e234-image-registry-private-configuration\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:25.458244 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.458212    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-598c48c5fb-7xrn5"]
Sep 08 11:36:25.462155 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.462129    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-598c48c5fb-7xrn5"]
Sep 08 11:36:25.482300 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:25.482271    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a310ac-d5de-4a56-b452-fa059e23e234" path="/var/lib/kubelet/pods/f6a310ac-d5de-4a56-b452-fa059e23e234/volumes"
Sep 08 11:36:26.096863 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.096797    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-649d487b9d-9klgn" podUID="0c70774e-ce4a-4baf-a8fb-6c4488f16d84" containerName="console" containerID="cri-o://f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a" gracePeriod=15
Sep 08 11:36:26.372985 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.372961    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:36:26.468630 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.468593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-service-ca\") pod \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") "
Sep 08 11:36:26.468804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.468691    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-oauth-serving-cert\") pod \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") "
Sep 08 11:36:26.468804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.468713    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-serving-cert\") pod \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") "
Sep 08 11:36:26.468804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.468730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l52f\" (UniqueName: \"kubernetes.io/projected/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-kube-api-access-7l52f\") pod \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") "
Sep 08 11:36:26.468804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.468767    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-oauth-config\") pod \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") "
Sep 08 11:36:26.468804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.468804    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-config\") pod \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\" (UID: \"0c70774e-ce4a-4baf-a8fb-6c4488f16d84\") "
Sep 08 11:36:26.469082 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.469056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-service-ca" (OuterVolumeSpecName: "service-ca") pod "0c70774e-ce4a-4baf-a8fb-6c4488f16d84" (UID: "0c70774e-ce4a-4baf-a8fb-6c4488f16d84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:26.469128 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.469090    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0c70774e-ce4a-4baf-a8fb-6c4488f16d84" (UID: "0c70774e-ce4a-4baf-a8fb-6c4488f16d84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:26.469356 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.469326    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-config" (OuterVolumeSpecName: "console-config") pod "0c70774e-ce4a-4baf-a8fb-6c4488f16d84" (UID: "0c70774e-ce4a-4baf-a8fb-6c4488f16d84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:26.471103 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.471072    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0c70774e-ce4a-4baf-a8fb-6c4488f16d84" (UID: "0c70774e-ce4a-4baf-a8fb-6c4488f16d84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:36:26.471386 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.471361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0c70774e-ce4a-4baf-a8fb-6c4488f16d84" (UID: "0c70774e-ce4a-4baf-a8fb-6c4488f16d84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:36:26.471483 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.471418    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-kube-api-access-7l52f" (OuterVolumeSpecName: "kube-api-access-7l52f") pod "0c70774e-ce4a-4baf-a8fb-6c4488f16d84" (UID: "0c70774e-ce4a-4baf-a8fb-6c4488f16d84"). InnerVolumeSpecName "kube-api-access-7l52f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:36:26.569899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.569861    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-oauth-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:26.569899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.569895    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:26.570124 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.569927    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l52f\" (UniqueName: \"kubernetes.io/projected/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-kube-api-access-7l52f\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:26.570124 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.569938    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-oauth-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:26.570124 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.569948    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-console-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:26.570124 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:26.569958    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0c70774e-ce4a-4baf-a8fb-6c4488f16d84-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:27.146689 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.146641    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c70774e-ce4a-4baf-a8fb-6c4488f16d84" containerID="f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a" exitCode=0
Sep 08 11:36:27.147087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.146717    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649d487b9d-9klgn"
Sep 08 11:36:27.147087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.146726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d487b9d-9klgn" event={"ID":"0c70774e-ce4a-4baf-a8fb-6c4488f16d84","Type":"ContainerDied","Data":"f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a"}
Sep 08 11:36:27.147087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.146808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649d487b9d-9klgn" event={"ID":"0c70774e-ce4a-4baf-a8fb-6c4488f16d84","Type":"ContainerDied","Data":"360798c5b86106d25951e3b8f512b6c418a85a0b01f4ffd16c15329c557ebba3"}
Sep 08 11:36:27.147087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.146828    2577 scope.go:117] "RemoveContainer" containerID="f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a"
Sep 08 11:36:27.155239 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.155219    2577 scope.go:117] "RemoveContainer" containerID="f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a"
Sep 08 11:36:27.155511 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:36:27.155492    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a\": container with ID starting with f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a not found: ID does not exist" containerID="f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a"
Sep 08 11:36:27.155582 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.155524    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a"} err="failed to get container status \"f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a\": rpc error: code = NotFound desc = could not find container \"f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a\": container with ID starting with f976f859bd2d2c5acc1847a9193b9ccf58568f5ce739bb6dd9f45172f9c8b60a not found: ID does not exist"
Sep 08 11:36:27.181641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.181600    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-649d487b9d-9klgn"]
Sep 08 11:36:27.184012 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.183991    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-649d487b9d-9klgn"]
Sep 08 11:36:27.481628 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:27.481532    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c70774e-ce4a-4baf-a8fb-6c4488f16d84" path="/var/lib/kubelet/pods/0c70774e-ce4a-4baf-a8fb-6c4488f16d84/volumes"
Sep 08 11:36:44.992756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:44.992693    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67698d64bd-4xcjf" podUID="8c7b0fe1-e912-41a9-af19-141dda7c6222" containerName="console" containerID="cri-o://9bb135b56323c95668cc82d233827fc525733b126df0c8f82424a791819fddab" gracePeriod=15
Sep 08 11:36:45.223034 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.222999    2577 generic.go:356] "Generic (PLEG): container finished" podID="8c7b0fe1-e912-41a9-af19-141dda7c6222" containerID="9bb135b56323c95668cc82d233827fc525733b126df0c8f82424a791819fddab" exitCode=0
Sep 08 11:36:45.223194 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.223054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67698d64bd-4xcjf" event={"ID":"8c7b0fe1-e912-41a9-af19-141dda7c6222","Type":"ContainerDied","Data":"9bb135b56323c95668cc82d233827fc525733b126df0c8f82424a791819fddab"}
Sep 08 11:36:45.268520 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.268439    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:36:45.336047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336013    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-serving-cert\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336047 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336053    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-oauth-config\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336080    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-config\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-service-ca\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336160    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj6mq\" (UniqueName: \"kubernetes.io/projected/8c7b0fe1-e912-41a9-af19-141dda7c6222-kube-api-access-pj6mq\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336453 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336298    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-oauth-serving-cert\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336453 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336373    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-trusted-ca-bundle\") pod \"8c7b0fe1-e912-41a9-af19-141dda7c6222\" (UID: \"8c7b0fe1-e912-41a9-af19-141dda7c6222\") "
Sep 08 11:36:45.336668 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336638    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-config" (OuterVolumeSpecName: "console-config") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:45.336740 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336660    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-service-ca" (OuterVolumeSpecName: "service-ca") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:45.336740 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:45.336958 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.336939    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:36:45.338266 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.338240    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:36:45.338366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.338303    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7b0fe1-e912-41a9-af19-141dda7c6222-kube-api-access-pj6mq" (OuterVolumeSpecName: "kube-api-access-pj6mq") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "kube-api-access-pj6mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:36:45.338366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.338333    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8c7b0fe1-e912-41a9-af19-141dda7c6222" (UID: "8c7b0fe1-e912-41a9-af19-141dda7c6222"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:36:45.437949 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437911    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-trusted-ca-bundle\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:45.437949 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437945    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:45.437949 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437954    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-oauth-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:45.438207 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437962    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-console-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:45.438207 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437971    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-service-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:45.438207 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437979    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj6mq\" (UniqueName: \"kubernetes.io/projected/8c7b0fe1-e912-41a9-af19-141dda7c6222-kube-api-access-pj6mq\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:45.438207 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:45.437988    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8c7b0fe1-e912-41a9-af19-141dda7c6222-oauth-serving-cert\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:36:46.228367 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:46.228341    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67698d64bd-4xcjf"
Sep 08 11:36:46.228819 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:46.228344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67698d64bd-4xcjf" event={"ID":"8c7b0fe1-e912-41a9-af19-141dda7c6222","Type":"ContainerDied","Data":"0b6f448c86cb2e026bb12998199f49f0811727a1d9e43f63e0d4f0eeb3443fd8"}
Sep 08 11:36:46.228819 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:46.228467    2577 scope.go:117] "RemoveContainer" containerID="9bb135b56323c95668cc82d233827fc525733b126df0c8f82424a791819fddab"
Sep 08 11:36:46.244424 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:46.244399    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67698d64bd-4xcjf"]
Sep 08 11:36:46.250380 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:46.250354    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67698d64bd-4xcjf"]
Sep 08 11:36:47.481850 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:36:47.481815    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7b0fe1-e912-41a9-af19-141dda7c6222" path="/var/lib/kubelet/pods/8c7b0fe1-e912-41a9-af19-141dda7c6222/volumes"
Sep 08 11:37:05.561260 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:05.561177    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:05.580800 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:05.580766    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:06.322781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:06.322753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:23.575362 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575318    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:37:23.575823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575655    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="prometheus" containerID="cri-o://1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f" gracePeriod=600
Sep 08 11:37:23.575823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575683    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy" containerID="cri-o://42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1" gracePeriod=600
Sep 08 11:37:23.575823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575718    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-web" containerID="cri-o://b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171" gracePeriod=600
Sep 08 11:37:23.575823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575744    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="config-reloader" containerID="cri-o://9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add" gracePeriod=600
Sep 08 11:37:23.576057 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575841    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44" gracePeriod=600
Sep 08 11:37:23.576057 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.575718    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="thanos-sidecar" containerID="cri-o://986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa" gracePeriod=600
Sep 08 11:37:23.820633 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.820607    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:23.860887 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860786    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-config\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.860887 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860835    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-serving-certs-ca-bundle\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.860887 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860864    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b74ng\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-kube-api-access-b74ng\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860890    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860917    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-grpc-tls\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-config-out\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.860988    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-metrics-client-ca\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861013    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-thanos-prometheus-http-client-file\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-tls-assets\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861058    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-1\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861089    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-trusted-ca-bundle\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861116    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-kube-rbac-proxy\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-2\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861172    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-db\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861216    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-web-config\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-tls\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861337    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-metrics-client-certs\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-0\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861392    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-kubelet-serving-ca-bundle\") pod \"1c64487e-f840-4c11-a46d-91d58613a13a\" (UID: \"1c64487e-f840-4c11-a46d-91d58613a13a\") "
Sep 08 11:37:23.861644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861582    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.862043 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861668    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.862043 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.861914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.862043 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.862017    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.862697 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.862405    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.863605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.863524    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.863897 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.863858    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.865119 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.865091    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:37:23.865231 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.865129    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:37:23.866440 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.866341    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.866440 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.866412    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.866898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.866870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-kube-api-access-b74ng" (OuterVolumeSpecName: "kube-api-access-b74ng") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "kube-api-access-b74ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:37:23.867251 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.867229    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.867899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.867770    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:37:23.867899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.867821    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.868044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.867921    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.868044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.867943    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-config" (OuterVolumeSpecName: "config") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.869720 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.869683    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-config-out" (OuterVolumeSpecName: "config-out") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:37:23.869998 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.869967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.870178 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.870160    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.879618 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.879549    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-web-config" (OuterVolumeSpecName: "web-config") pod "1c64487e-f840-4c11-a46d-91d58613a13a" (UID: "1c64487e-f840-4c11-a46d-91d58613a13a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:37:23.962342 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962311    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-web-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962342 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962339    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962342 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962350    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962360    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-metrics-client-certs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962369    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962390    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962399    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-config\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962407    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962417    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b74ng\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-kube-api-access-b74ng\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962427    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962436    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-grpc-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962443    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-config-out\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962450    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-configmap-metrics-client-ca\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962460    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962468    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c64487e-f840-4c11-a46d-91d58613a13a-tls-assets\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962476    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962484    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c64487e-f840-4c11-a46d-91d58613a13a-secret-kube-rbac-proxy\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962493    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:23.962589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:23.962501    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1c64487e-f840-4c11-a46d-91d58613a13a-prometheus-k8s-db\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:37:24.379641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379597    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44" exitCode=0
Sep 08 11:37:24.379641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379626    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1" exitCode=0
Sep 08 11:37:24.379641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379632    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171" exitCode=0
Sep 08 11:37:24.379641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379638    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa" exitCode=0
Sep 08 11:37:24.379641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379644    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add" exitCode=0
Sep 08 11:37:24.379641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379649    2577 generic.go:356] "Generic (PLEG): container finished" podID="1c64487e-f840-4c11-a46d-91d58613a13a" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f" exitCode=0
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379677    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"}
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"}
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"}
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"}
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379814    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"}
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379879    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"}
Sep 08 11:37:24.379956 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.379919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1c64487e-f840-4c11-a46d-91d58613a13a","Type":"ContainerDied","Data":"b1d9d3aff1c34c91ffe317e644204b2f27908b18f513c8090737c84c61b49642"}
Sep 08 11:37:24.391673 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.391639    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.399249 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.399226    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.405070 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.405023    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:37:24.407107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.407082    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.408195 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.408179    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:37:24.413901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.413881    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.420770 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.420755    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.428014 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.427990    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.432532 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.432511    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:37:24.432990 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.432970    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7b0fe1-e912-41a9-af19-141dda7c6222" containerName="console"
Sep 08 11:37:24.433053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.432997    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7b0fe1-e912-41a9-af19-141dda7c6222" containerName="console"
Sep 08 11:37:24.433053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433010    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-thanos"
Sep 08 11:37:24.433053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433019    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-thanos"
Sep 08 11:37:24.433053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433037    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="prometheus"
Sep 08 11:37:24.433053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433045    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="prometheus"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433056    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a310ac-d5de-4a56-b452-fa059e23e234" containerName="registry"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433064    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a310ac-d5de-4a56-b452-fa059e23e234" containerName="registry"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433072    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="config-reloader"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433080    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="config-reloader"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433094    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="thanos-sidecar"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433102    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="thanos-sidecar"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433117    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-web"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433126    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-web"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433139    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433149    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433160    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="init-config-reloader"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433167    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="init-config-reloader"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433180    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c70774e-ce4a-4baf-a8fb-6c4488f16d84" containerName="console"
Sep 08 11:37:24.433204 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433188    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c70774e-ce4a-4baf-a8fb-6c4488f16d84" containerName="console"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433269    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-web"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433281    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433290    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="kube-rbac-proxy-thanos"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433300    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="prometheus"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433308    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c70774e-ce4a-4baf-a8fb-6c4488f16d84" containerName="console"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433318    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a310ac-d5de-4a56-b452-fa059e23e234" containerName="registry"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433326    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7b0fe1-e912-41a9-af19-141dda7c6222" containerName="console"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433334    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="config-reloader"
Sep 08 11:37:24.433649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.433341    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" containerName="thanos-sidecar"
Sep 08 11:37:24.436233 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.436213    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.438473 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.438434    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.438605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.438481    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"} err="failed to get container status \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist"
Sep 08 11:37:24.438605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.438501    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.438605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.438590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.438984 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.438957    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.439087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.438990    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"} err="failed to get container status \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist"
Sep 08 11:37:24.439087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.439011    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.439422 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.439404    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.439502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.439431    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"} err="failed to get container status \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist"
Sep 08 11:37:24.439502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.439451    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.439740 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.439721    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.439805 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.439748    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"} err="failed to get container status \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist"
Sep 08 11:37:24.439805 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.439770    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.440040 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.440019    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.440097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440047    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"} err="failed to get container status \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist"
Sep 08 11:37:24.440097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440066    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.440278 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.440263    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.440337 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440285    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"} err="failed to get container status \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist"
Sep 08 11:37:24.440337 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440303    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.440546 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:37:24.440531    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.440640 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440551    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"} err="failed to get container status \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist"
Sep 08 11:37:24.440640 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440582    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.440846 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440827    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"} err="failed to get container status \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist"
Sep 08 11:37:24.440897 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.440846    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.441082 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441057    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"} err="failed to get container status \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist"
Sep 08 11:37:24.441082 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441082    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.441304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441171    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 11:37:24.441304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441177    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 11:37:24.441481 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441352    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"} err="failed to get container status \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist"
Sep 08 11:37:24.441481 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441377    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.441481 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441441    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 11:37:24.441710 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441529    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 11:37:24.441775 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441704    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"} err="failed to get container status \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist"
Sep 08 11:37:24.441775 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441766    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.441886 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.441819    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-45ibie7uvjccj\""
Sep 08 11:37:24.442128 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 11:37:24.442529 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442142    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 11:37:24.442529 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442221    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 11:37:24.442529 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442255    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 11:37:24.442529 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442322    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"} err="failed to get container status \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist"
Sep 08 11:37:24.442529 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442345    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.442845 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442574    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 11:37:24.442845 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 11:37:24.442845 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442640    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 11:37:24.442986 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 11:37:24.442986 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.442878    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 11:37:24.443103 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443077    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"} err="failed to get container status \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist"
Sep 08 11:37:24.443158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443103    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.443395 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443375    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-68mkd\""
Sep 08 11:37:24.443501 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443372    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"} err="failed to get container status \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist"
Sep 08 11:37:24.443501 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443415    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.443892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443865    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"} err="failed to get container status \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist"
Sep 08 11:37:24.443968 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.443900    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.444251 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.444226    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"} err="failed to get container status \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist"
Sep 08 11:37:24.444334 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.444252    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.445037 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.444878    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 11:37:24.446202 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.445222    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"} err="failed to get container status \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist"
Sep 08 11:37:24.446202 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.445247    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.447909 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.447888    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 11:37:24.448389 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.448368    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"} err="failed to get container status \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist"
Sep 08 11:37:24.448389 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.448389    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.448692 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.448674    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"} err="failed to get container status \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist"
Sep 08 11:37:24.448692 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.448692    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.448975 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.448955    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"} err="failed to get container status \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist"
Sep 08 11:37:24.448975 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.448975    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.449239 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449215    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"} err="failed to get container status \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist"
Sep 08 11:37:24.449239 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449235    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.449470 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449450    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"} err="failed to get container status \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist"
Sep 08 11:37:24.449470 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449470    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.449747 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449729    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"} err="failed to get container status \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist"
Sep 08 11:37:24.449747 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449746    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.449963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449947    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"} err="failed to get container status \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist"
Sep 08 11:37:24.449963 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.449962    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.450211 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450192    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"} err="failed to get container status \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist"
Sep 08 11:37:24.450249 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450211    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.450446 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450429    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"} err="failed to get container status \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist"
Sep 08 11:37:24.450495 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450447    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.450677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450661    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"} err="failed to get container status \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist"
Sep 08 11:37:24.450724 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450677    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.450904 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450882    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"} err="failed to get container status \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist"
Sep 08 11:37:24.450904 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.450903    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.451191 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451164    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"} err="failed to get container status \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist"
Sep 08 11:37:24.451191 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451182    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.451464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451445    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"} err="failed to get container status \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist"
Sep 08 11:37:24.451464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451462    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.451735 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451716    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"} err="failed to get container status \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist"
Sep 08 11:37:24.451795 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451735    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.451973 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451957    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"} err="failed to get container status \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist"
Sep 08 11:37:24.452028 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.451974    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.452185 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.452169    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"} err="failed to get container status \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist"
Sep 08 11:37:24.452231 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.452185    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.452414 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.452396    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"} err="failed to get container status \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist"
Sep 08 11:37:24.452464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.452413    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.452649 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.452633    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"} err="failed to get container status \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist"
Sep 08 11:37:24.452707 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.452649    2577 scope.go:117] "RemoveContainer" containerID="b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"
Sep 08 11:37:24.453126 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.453066    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44"} err="failed to get container status \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": rpc error: code = NotFound desc = could not find container \"b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44\": container with ID starting with b6daa6da55c1b26c95bdbe8957f71217ba09bc7ccf48f21bd0bdedaa41b49e44 not found: ID does not exist"
Sep 08 11:37:24.453126 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.453092    2577 scope.go:117] "RemoveContainer" containerID="42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"
Sep 08 11:37:24.453935 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.453914    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1"} err="failed to get container status \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": rpc error: code = NotFound desc = could not find container \"42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1\": container with ID starting with 42c9138a6eab90b6c9e989471476497fd6b0b1a21b7c57e33edcaba7c0abe2d1 not found: ID does not exist"
Sep 08 11:37:24.453935 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.453936    2577 scope.go:117] "RemoveContainer" containerID="b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"
Sep 08 11:37:24.454222 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454205    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171"} err="failed to get container status \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": rpc error: code = NotFound desc = could not find container \"b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171\": container with ID starting with b53990bbf453408aa2a9bcb2cbdd11ebd9474063fa25c024dd12264e40548171 not found: ID does not exist"
Sep 08 11:37:24.454370 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454221    2577 scope.go:117] "RemoveContainer" containerID="986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"
Sep 08 11:37:24.454532 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454500    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa"} err="failed to get container status \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": rpc error: code = NotFound desc = could not find container \"986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa\": container with ID starting with 986d137660925e0366c17908123f5c9d54f2d4dbd9c06673872392738215c7fa not found: ID does not exist"
Sep 08 11:37:24.454532 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454527    2577 scope.go:117] "RemoveContainer" containerID="9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"
Sep 08 11:37:24.454853 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454832    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add"} err="failed to get container status \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": rpc error: code = NotFound desc = could not find container \"9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add\": container with ID starting with 9d248cc8961f697397daed8e47d1d07a910f8f762ec961cd14b8d9cb538a4add not found: ID does not exist"
Sep 08 11:37:24.454950 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454856    2577 scope.go:117] "RemoveContainer" containerID="1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"
Sep 08 11:37:24.455011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.454944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:37:24.455136 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.455117    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f"} err="failed to get container status \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": rpc error: code = NotFound desc = could not find container \"1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f\": container with ID starting with 1fe6f580ec9c8af223d78b2396ae2b9a6a70ae91836227dca5972f9d77ef927f not found: ID does not exist"
Sep 08 11:37:24.455194 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.455136    2577 scope.go:117] "RemoveContainer" containerID="3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"
Sep 08 11:37:24.455416 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.455399    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7"} err="failed to get container status \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": rpc error: code = NotFound desc = could not find container \"3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7\": container with ID starting with 3b1167b88f84ea0542c8226559ac40db009f289fd91890798bd02a7cd731edc7 not found: ID does not exist"
Sep 08 11:37:24.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-config\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tm4s\" (UniqueName: \"kubernetes.io/projected/01dd4c31-0a95-4e66-86f2-e237e99dcda9-kube-api-access-9tm4s\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567684    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.567821 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-web-config\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.567995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01dd4c31-0a95-4e66-86f2-e237e99dcda9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.568014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.568031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.568047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01dd4c31-0a95-4e66-86f2-e237e99dcda9-config-out\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.568089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.568079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.669551 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.669551 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tm4s\" (UniqueName: \"kubernetes.io/projected/01dd4c31-0a95-4e66-86f2-e237e99dcda9-kube-api-access-9tm4s\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.669551 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670153 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670153 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670153 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670153 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670153 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.669678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670451 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670451 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670451 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670451 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-web-config\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670451 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670451 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01dd4c31-0a95-4e66-86f2-e237e99dcda9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01dd4c31-0a95-4e66-86f2-e237e99dcda9-config-out\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-config\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.670781 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.670673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.671494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.671180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.671494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.671202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.671709 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.671617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.672874 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.671910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.672874 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.672829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.673120 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.673094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.673762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.673738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.673865 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.673790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01dd4c31-0a95-4e66-86f2-e237e99dcda9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.673865 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.673822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.673990 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.673894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/01dd4c31-0a95-4e66-86f2-e237e99dcda9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.674276 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.674252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.674802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.674777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.675487 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.675465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.675807 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.675787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01dd4c31-0a95-4e66-86f2-e237e99dcda9-config-out\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.675894 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.675802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.676218 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.676191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-config\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.676298 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.676227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01dd4c31-0a95-4e66-86f2-e237e99dcda9-web-config\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.677987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.677970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tm4s\" (UniqueName: \"kubernetes.io/projected/01dd4c31-0a95-4e66-86f2-e237e99dcda9-kube-api-access-9tm4s\") pod \"prometheus-k8s-0\" (UID: \"01dd4c31-0a95-4e66-86f2-e237e99dcda9\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:24.750770 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:24.750730    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:37:25.034589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:25.034514    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 11:37:25.037066 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:37:25.037040    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01dd4c31_0a95_4e66_86f2_e237e99dcda9.slice/crio-134d88a8227c02ba9ad07afb0c8829a5e33e9c804f6464e219c2d822c87271e4 WatchSource:0}: Error finding container 134d88a8227c02ba9ad07afb0c8829a5e33e9c804f6464e219c2d822c87271e4: Status 404 returned error can't find the container with id 134d88a8227c02ba9ad07afb0c8829a5e33e9c804f6464e219c2d822c87271e4
Sep 08 11:37:25.386513 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:25.386421    2577 generic.go:356] "Generic (PLEG): container finished" podID="01dd4c31-0a95-4e66-86f2-e237e99dcda9" containerID="607911e26b3215d9c2121dba4e0824ec6d54b54575e65baded00f4b822cf87bd" exitCode=0
Sep 08 11:37:25.386681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:25.386504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerDied","Data":"607911e26b3215d9c2121dba4e0824ec6d54b54575e65baded00f4b822cf87bd"}
Sep 08 11:37:25.386681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:25.386593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"134d88a8227c02ba9ad07afb0c8829a5e33e9c804f6464e219c2d822c87271e4"}
Sep 08 11:37:25.483509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:25.483482    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c64487e-f840-4c11-a46d-91d58613a13a" path="/var/lib/kubelet/pods/1c64487e-f840-4c11-a46d-91d58613a13a/volumes"
Sep 08 11:37:26.394408 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.394375    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"9d238db7288871b826fb9002c4edb27655f09b7e144164f29720945a60f17f49"}
Sep 08 11:37:26.394808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.394476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"3c4ff6a4c1fd9f8e2f1a34f552dbe307da19365ee65690e082b3238e425547b1"}
Sep 08 11:37:26.394808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.394506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"85f490a9eb150e049540d7b89ec29cb8419aae277f9e33c4cae711bf4090ae22"}
Sep 08 11:37:26.394808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.394531    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"be47b65dc7cd0904843baf0f056ab0d6869461daa03dc75b74798797973362f5"}
Sep 08 11:37:26.394808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.394553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"31908ed108224ad39196800942eb00365ff0a66712199f58803b2887e96e8263"}
Sep 08 11:37:26.394808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.394598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"01dd4c31-0a95-4e66-86f2-e237e99dcda9","Type":"ContainerStarted","Data":"82e92c88b4077649f527c802a27d419968e2bbc05b0e0b08d84aa75f9683c275"}
Sep 08 11:37:26.424307 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:26.424252    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.404525776 podStartE2EDuration="2.424233363s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.707587ms" isStatefulPod=false podCreationTimestamp="2026-09-08 11:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:37:26.422521153 +0000 UTC m=+199.439313944" watchObservedRunningTime="2026-09-08 11:37:26.424233363 +0000 UTC m=+199.441026150"
Sep 08 11:37:29.751576 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:37:29.751529    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:38:24.751214 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:38:24.751169    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:38:24.766302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:38:24.766277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:38:25.639612 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:38:25.639582    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 11:39:07.365480 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:39:07.365441    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:39:07.366177 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:39:07.365720    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:39:07.372754 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:39:07.372735    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 11:40:02.134254 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.134176    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"]
Sep 08 11:40:02.137758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.137743    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.139894 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.139858    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 08 11:40:02.140037 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.139868    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 08 11:40:02.140037 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.139872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dcc6h\""
Sep 08 11:40:02.140037 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.139968    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 08 11:40:02.141006 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.140979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 08 11:40:02.141141 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.141121    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 11:40:02.141507 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.141488    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 11:40:02.142309 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.142293    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 08 11:40:02.151511 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.151489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"]
Sep 08 11:40:02.225937 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.225906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-online-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.226107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.225948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-offline-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.226107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.225965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.226107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.226029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5qt\" (UniqueName: \"kubernetes.io/projected/119a21a2-3477-4483-bfc6-8a9cfc834894-kube-api-access-qf5qt\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.226107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.226060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/119a21a2-3477-4483-bfc6-8a9cfc834894-feast-data\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.226107 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.226089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327317 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5qt\" (UniqueName: \"kubernetes.io/projected/119a21a2-3477-4483-bfc6-8a9cfc834894-kube-api-access-qf5qt\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327317 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/119a21a2-3477-4483-bfc6-8a9cfc834894-feast-data\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327512 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327512 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-online-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327618 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-offline-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327618 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327721 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.327662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/119a21a2-3477-4483-bfc6-8a9cfc834894-feast-data\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.327721 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:40:02.327677    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 11:40:02.327803 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:40:02.327742    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls podName:119a21a2-3477-4483-bfc6-8a9cfc834894 nodeName:}" failed. No retries permitted until 2026-09-08 11:40:02.827723188 +0000 UTC m=+355.844515956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls") pod "feast-simple-feast-setup-7cd445644f-jgdbw" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 11:40:02.329917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.329892    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.330016 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.329934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-online-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.330016 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.330005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-offline-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.338046 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.338024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5qt\" (UniqueName: \"kubernetes.io/projected/119a21a2-3477-4483-bfc6-8a9cfc834894-kube-api-access-qf5qt\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.832080 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.832045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:02.834516 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:02.834484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-jgdbw\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:03.069080 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:03.069048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:03.361527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:03.361493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"]
Sep 08 11:40:03.365126 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:40:03.365066    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod119a21a2_3477_4483_bfc6_8a9cfc834894.slice/crio-39f474a13040e99cabb39eb4d03efd8ea35cee8e23ba343ba586cdb80fe5cf2c WatchSource:0}: Error finding container 39f474a13040e99cabb39eb4d03efd8ea35cee8e23ba343ba586cdb80fe5cf2c: Status 404 returned error can't find the container with id 39f474a13040e99cabb39eb4d03efd8ea35cee8e23ba343ba586cdb80fe5cf2c
Sep 08 11:40:03.366925 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:03.366909    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:40:03.990186 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:03.988435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"39f474a13040e99cabb39eb4d03efd8ea35cee8e23ba343ba586cdb80fe5cf2c"}
Sep 08 11:40:31.110996 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:31.110956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"d3dada9cc67ff0feeff94237e904ad25b72c6d542094f0623ed0571a1d1dda30"}
Sep 08 11:40:35.130651 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:35.130618    2577 generic.go:356] "Generic (PLEG): container finished" podID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerID="d3dada9cc67ff0feeff94237e904ad25b72c6d542094f0623ed0571a1d1dda30" exitCode=0
Sep 08 11:40:35.131038 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:35.130683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"d3dada9cc67ff0feeff94237e904ad25b72c6d542094f0623ed0571a1d1dda30"}
Sep 08 11:40:36.136385 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:36.136348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"f6e8f1ffb9354016ac8d5cf40ae93c383ed135548bd769ce96aa000d348d59bd"}
Sep 08 11:40:41.158844 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:41.158807    2577 generic.go:356] "Generic (PLEG): container finished" podID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerID="f6e8f1ffb9354016ac8d5cf40ae93c383ed135548bd769ce96aa000d348d59bd" exitCode=0
Sep 08 11:40:41.159268 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:41.158858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"f6e8f1ffb9354016ac8d5cf40ae93c383ed135548bd769ce96aa000d348d59bd"}
Sep 08 11:40:41.168051 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:41.168031    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 08 11:40:42.171588 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:42.171424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"debe6eb8f310ddc1aacca70e06768343d5869e44a6507e1653c24e1047dea915"}
Sep 08 11:40:42.171588 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:42.171500    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"a79f53a9a21b4e5171716c7f041bbce2f768b6701bdd598536f287da59c12617"}
Sep 08 11:40:42.171588 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:42.171527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"e18e85bfbc3c7fa085235b156dbb988f91c01c7a1a543b1cc446bce9b4af9157"}
Sep 08 11:40:42.171588 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:42.171548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerStarted","Data":"91e6a950d1b783fc73f6a1557f88f43b72a3fafa6c225980778b21a7141c9c9c"}
Sep 08 11:40:42.199486 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:42.199418    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podStartSLOduration=13.497841393 podStartE2EDuration="40.199396821s" totalImagesPullingTime="26.701555428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:40:42.198645461 +0000 UTC m=+395.215438251" watchObservedRunningTime="2026-09-08 11:40:42.199396821 +0000 UTC m=+395.216189611"
Sep 08 11:40:43.069994 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:43.069946    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:43.070221 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:43.070021    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:43.070221 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:43.070044    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:43.070221 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:43.070062    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:45.069973 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.069931    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:45.070478 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.069999    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:45.070478 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.070019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:45.070478 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.070037    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:45.072327 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.072282    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 08 11:40:45.072472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.072365    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused"
Sep 08 11:40:45.072472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.072380    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 08 11:40:45.072472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:45.072443    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
Sep 08 11:40:48.069802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:48.069746    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused"
Sep 08 11:40:48.069802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:48.069766    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 08 11:40:48.070471 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:48.069804    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused"
Sep 08 11:40:48.070471 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:48.069887    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 08 11:40:51.070244 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.070210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.070739 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.070717    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.070868 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.070854    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.071112 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.071090    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.076022 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.076000    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.219313 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.219285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.219475 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.219366    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:40:51.222015 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:40:51.221990    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:41:54.346224 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.346191    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"]
Sep 08 11:41:54.346884 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.346427    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="registry" containerID="cri-o://91e6a950d1b783fc73f6a1557f88f43b72a3fafa6c225980778b21a7141c9c9c" gracePeriod=30
Sep 08 11:41:54.346884 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.346447    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui" containerID="cri-o://debe6eb8f310ddc1aacca70e06768343d5869e44a6507e1653c24e1047dea915" gracePeriod=30
Sep 08 11:41:54.346884 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.346628    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online" containerID="cri-o://e18e85bfbc3c7fa085235b156dbb988f91c01c7a1a543b1cc446bce9b4af9157" gracePeriod=30
Sep 08 11:41:54.346884 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.346671    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="offline" containerID="cri-o://a79f53a9a21b4e5171716c7f041bbce2f768b6701bdd598536f287da59c12617" gracePeriod=30
Sep 08 11:41:54.755127 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.755027    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"]
Sep 08 11:41:54.759823 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.759787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.789480 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.789452    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-hvrlf\""
Sep 08 11:41:54.799269 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.799235    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"]
Sep 08 11:41:54.866187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.866152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.866187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.866188    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f66f86fa-5804-48fe-8eca-f52e0af7405b-feast-data\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.866431 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.866213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-offline-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.866431 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.866351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6sv\" (UniqueName: \"kubernetes.io/projected/f66f86fa-5804-48fe-8eca-f52e0af7405b-kube-api-access-sg6sv\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.866431 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.866403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.866623 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.866452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-online-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967365 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.967330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-offline-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.967405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6sv\" (UniqueName: \"kubernetes.io/projected/f66f86fa-5804-48fe-8eca-f52e0af7405b-kube-api-access-sg6sv\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.967446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.967479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-online-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967715 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.967559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967715 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.967601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f66f86fa-5804-48fe-8eca-f52e0af7405b-feast-data\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.967868 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:41:54.967837    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 11:41:54.967946 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:41:54.967931    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls podName:f66f86fa-5804-48fe-8eca-f52e0af7405b nodeName:}" failed. No retries permitted until 2026-09-08 11:41:55.467909849 +0000 UTC m=+468.484702617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls") pod "feast-simple-feast-setup-7cd445644f-gxf27" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 11:41:54.968053 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.968032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f66f86fa-5804-48fe-8eca-f52e0af7405b-feast-data\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.970054 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.970018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-ui-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.970176 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.970153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-offline-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.970330 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.970313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-online-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:54.975676 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:54.975655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6sv\" (UniqueName: \"kubernetes.io/projected/f66f86fa-5804-48fe-8eca-f52e0af7405b-kube-api-access-sg6sv\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:55.471631 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.471522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:55.474099 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.474070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls\") pod \"feast-simple-feast-setup-7cd445644f-gxf27\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") " pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:55.475587 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.475545    2577 generic.go:356] "Generic (PLEG): container finished" podID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerID="debe6eb8f310ddc1aacca70e06768343d5869e44a6507e1653c24e1047dea915" exitCode=0
Sep 08 11:41:55.475587 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.475584    2577 generic.go:356] "Generic (PLEG): container finished" podID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerID="e18e85bfbc3c7fa085235b156dbb988f91c01c7a1a543b1cc446bce9b4af9157" exitCode=0
Sep 08 11:41:55.475741 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.475598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"debe6eb8f310ddc1aacca70e06768343d5869e44a6507e1653c24e1047dea915"}
Sep 08 11:41:55.475741 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.475648    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"e18e85bfbc3c7fa085235b156dbb988f91c01c7a1a543b1cc446bce9b4af9157"}
Sep 08 11:41:55.670620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.670584    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:41:55.948510 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:55.948479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"]
Sep 08 11:41:55.950102 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:41:55.950074    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf66f86fa_5804_48fe_8eca_f52e0af7405b.slice/crio-a3ebff4d0c12ec09257279f7c5da76eaba0f83081e48956a1a093715fb402e72 WatchSource:0}: Error finding container a3ebff4d0c12ec09257279f7c5da76eaba0f83081e48956a1a093715fb402e72: Status 404 returned error can't find the container with id a3ebff4d0c12ec09257279f7c5da76eaba0f83081e48956a1a093715fb402e72
Sep 08 11:41:56.481805 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:56.481770    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"144695f15395ddb5aaf72af025dd5107ca1dcb3b1a4abacf48ba1044247e389e"}
Sep 08 11:41:56.482201 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:41:56.481818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"a3ebff4d0c12ec09257279f7c5da76eaba0f83081e48956a1a093715fb402e72"}
Sep 08 11:42:01.218964 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:01.218912    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 08 11:42:01.219395 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:01.218932    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 08 11:42:01.502412 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:01.502381    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerID="144695f15395ddb5aaf72af025dd5107ca1dcb3b1a4abacf48ba1044247e389e" exitCode=0
Sep 08 11:42:01.502607 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:01.502466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"144695f15395ddb5aaf72af025dd5107ca1dcb3b1a4abacf48ba1044247e389e"}
Sep 08 11:42:02.509069 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:02.509032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"64b4a70a23c5744c0732543b7db0b5a91ce659486d7a335a639d2210d3e9dea3"}
Sep 08 11:42:07.530444 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:07.530406    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerID="64b4a70a23c5744c0732543b7db0b5a91ce659486d7a335a639d2210d3e9dea3" exitCode=0
Sep 08 11:42:07.530938 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:07.530476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"64b4a70a23c5744c0732543b7db0b5a91ce659486d7a335a639d2210d3e9dea3"}
Sep 08 11:42:08.541249 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:08.541205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"ac7ae7cc363e9efd943ad923cccae0613dffb36f215540e2118c1ef6f14e37e9"}
Sep 08 11:42:08.541767 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:08.541276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"440c26ca002d97b15a1cdb3d873da543d9a417b76252bfc38178d50cbf0d2cb9"}
Sep 08 11:42:08.541767 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:08.541300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"5efd330e87bd5049b658211ee0bb1f034753149698aa012c17f45390c1114ca2"}
Sep 08 11:42:08.541767 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:08.541318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerStarted","Data":"c9f1353820ba165cd5020407518228565bb1311c69237c95da2820bf4134272a"}
Sep 08 11:42:08.569111 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:08.569041    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podStartSLOduration=14.569017613 podStartE2EDuration="14.569017613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:41:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:42:08.565301772 +0000 UTC m=+481.582094572" watchObservedRunningTime="2026-09-08 11:42:08.569017613 +0000 UTC m=+481.585810402"
Sep 08 11:42:10.670837 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.670770    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:10.671337 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.670962    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:10.671337 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.670996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:10.671337 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.671013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:10.673255 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.673213    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused"
Sep 08 11:42:10.673366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.673247    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 08 11:42:10.673366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.673348    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 08 11:42:10.673481 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:10.673382    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused"
Sep 08 11:42:11.219299 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:11.219235    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 08 11:42:11.219895 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:11.219858    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 08 11:42:13.671773 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:13.671723    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused"
Sep 08 11:42:13.672418 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:13.671748    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused"
Sep 08 11:42:13.672506 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:13.671828    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 08 11:42:13.672506 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:13.671858    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 08 11:42:15.671112 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:15.671068    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:15.671511 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:15.671132    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:15.671511 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:15.671146    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:15.671511 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:15.671159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:16.671867 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:16.671834    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:16.672387 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:16.672365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:16.672509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:16.672491    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:16.672656 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:16.672621    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:16.677205 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:16.677185    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:17.591315 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:17.591285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:17.591480 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:17.591464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:17.594068 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:17.594042    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:42:21.219291 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:21.219242    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused"
Sep 08 11:42:21.219752 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:21.219254    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused"
Sep 08 11:42:21.219752 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:21.219391    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:42:21.219752 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:21.219552    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:42:24.622812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:24.622730    2577 generic.go:356] "Generic (PLEG): container finished" podID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerID="a79f53a9a21b4e5171716c7f041bbce2f768b6701bdd598536f287da59c12617" exitCode=137
Sep 08 11:42:24.622812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:24.622754    2577 generic.go:356] "Generic (PLEG): container finished" podID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerID="91e6a950d1b783fc73f6a1557f88f43b72a3fafa6c225980778b21a7141c9c9c" exitCode=137
Sep 08 11:42:24.622812 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:24.622802    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"a79f53a9a21b4e5171716c7f041bbce2f768b6701bdd598536f287da59c12617"}
Sep 08 11:42:24.623256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:24.622841    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"91e6a950d1b783fc73f6a1557f88f43b72a3fafa6c225980778b21a7141c9c9c"}
Sep 08 11:42:24.991798 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:24.991773    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:42:25.022507 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.022471    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf5qt\" (UniqueName: \"kubernetes.io/projected/119a21a2-3477-4483-bfc6-8a9cfc834894-kube-api-access-qf5qt\") pod \"119a21a2-3477-4483-bfc6-8a9cfc834894\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") "
Sep 08 11:42:25.022681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.022528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls\") pod \"119a21a2-3477-4483-bfc6-8a9cfc834894\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") "
Sep 08 11:42:25.022681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.022589    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-registry-tls\") pod \"119a21a2-3477-4483-bfc6-8a9cfc834894\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") "
Sep 08 11:42:25.022681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.022621    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/119a21a2-3477-4483-bfc6-8a9cfc834894-feast-data\") pod \"119a21a2-3477-4483-bfc6-8a9cfc834894\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") "
Sep 08 11:42:25.022839 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.022696    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-online-tls\") pod \"119a21a2-3477-4483-bfc6-8a9cfc834894\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") "
Sep 08 11:42:25.022839 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.022729    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-offline-tls\") pod \"119a21a2-3477-4483-bfc6-8a9cfc834894\" (UID: \"119a21a2-3477-4483-bfc6-8a9cfc834894\") "
Sep 08 11:42:25.023316 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.023272    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/119a21a2-3477-4483-bfc6-8a9cfc834894-feast-data" (OuterVolumeSpecName: "feast-data") pod "119a21a2-3477-4483-bfc6-8a9cfc834894" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:42:25.025414 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.025355    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-online-tls" (OuterVolumeSpecName: "online-tls") pod "119a21a2-3477-4483-bfc6-8a9cfc834894" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:42:25.025414 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.025364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "119a21a2-3477-4483-bfc6-8a9cfc834894" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:42:25.025414 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.025402    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "119a21a2-3477-4483-bfc6-8a9cfc834894" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:42:25.025618 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.025426    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119a21a2-3477-4483-bfc6-8a9cfc834894-kube-api-access-qf5qt" (OuterVolumeSpecName: "kube-api-access-qf5qt") pod "119a21a2-3477-4483-bfc6-8a9cfc834894" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894"). InnerVolumeSpecName "kube-api-access-qf5qt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:42:25.025618 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.025483    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "119a21a2-3477-4483-bfc6-8a9cfc834894" (UID: "119a21a2-3477-4483-bfc6-8a9cfc834894"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:42:25.123364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.123312    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf5qt\" (UniqueName: \"kubernetes.io/projected/119a21a2-3477-4483-bfc6-8a9cfc834894-kube-api-access-qf5qt\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:42:25.123364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.123356    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:42:25.123364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.123367    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:42:25.123364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.123377    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/119a21a2-3477-4483-bfc6-8a9cfc834894-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:42:25.123364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.123385    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:42:25.123710 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.123394    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/119a21a2-3477-4483-bfc6-8a9cfc834894-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:42:25.629741 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.629713    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"
Sep 08 11:42:25.629741 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.629727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw" event={"ID":"119a21a2-3477-4483-bfc6-8a9cfc834894","Type":"ContainerDied","Data":"39f474a13040e99cabb39eb4d03efd8ea35cee8e23ba343ba586cdb80fe5cf2c"}
Sep 08 11:42:25.630271 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.629784    2577 scope.go:117] "RemoveContainer" containerID="debe6eb8f310ddc1aacca70e06768343d5869e44a6507e1653c24e1047dea915"
Sep 08 11:42:25.640166 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.640136    2577 scope.go:117] "RemoveContainer" containerID="a79f53a9a21b4e5171716c7f041bbce2f768b6701bdd598536f287da59c12617"
Sep 08 11:42:25.647632 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.647605    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"]
Sep 08 11:42:25.648750 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.648733    2577 scope.go:117] "RemoveContainer" containerID="e18e85bfbc3c7fa085235b156dbb988f91c01c7a1a543b1cc446bce9b4af9157"
Sep 08 11:42:25.651096 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.651074    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-jgdbw"]
Sep 08 11:42:25.657865 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.657845    2577 scope.go:117] "RemoveContainer" containerID="91e6a950d1b783fc73f6a1557f88f43b72a3fafa6c225980778b21a7141c9c9c"
Sep 08 11:42:25.666638 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.666619    2577 scope.go:117] "RemoveContainer" containerID="f6e8f1ffb9354016ac8d5cf40ae93c383ed135548bd769ce96aa000d348d59bd"
Sep 08 11:42:25.674333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:25.674305    2577 scope.go:117] "RemoveContainer" containerID="d3dada9cc67ff0feeff94237e904ad25b72c6d542094f0623ed0571a1d1dda30"
Sep 08 11:42:27.482479 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:42:27.482443    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" path="/var/lib/kubelet/pods/119a21a2-3477-4483-bfc6-8a9cfc834894/volumes"
Sep 08 11:43:19.798824 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.798791    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"]
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799075    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="feast-apply"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799085    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="feast-apply"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799098    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="registry"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799104    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="registry"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799113    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799118    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799128    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="offline"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799133    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="offline"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799141    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="feast-init"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799147    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="feast-init"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799159    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799164    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799210    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="online"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799220    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="registry"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799227    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="offline"
Sep 08 11:43:19.799256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.799232    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="119a21a2-3477-4483-bfc6-8a9cfc834894" containerName="ui"
Sep 08 11:43:19.803532 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.803516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.805835 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.805811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 08 11:43:19.805968 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.805878    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 08 11:43:19.805968 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.805925    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 08 11:43:19.806088 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.805981    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-bdmpq\""
Sep 08 11:43:19.806176 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.806160    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 08 11:43:19.806236 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.806201    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 08 11:43:19.806304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.806278    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 08 11:43:19.806592 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.806575    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 08 11:43:19.815659 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.815637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"]
Sep 08 11:43:19.882638 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.882603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-online-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.882808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.882658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c949c646-f295-49d9-8b5f-1dd32a430422-registry-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.882808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.882685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.882808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.882731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-offline-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.882808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.882789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c949c646-f295-49d9-8b5f-1dd32a430422-feast-data\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.882947 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.882824    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fljkt\" (UniqueName: \"kubernetes.io/projected/c949c646-f295-49d9-8b5f-1dd32a430422-kube-api-access-fljkt\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.983804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.983772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c949c646-f295-49d9-8b5f-1dd32a430422-registry-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.983804 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.983802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.984040 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.983826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-offline-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.984040 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.983849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c949c646-f295-49d9-8b5f-1dd32a430422-feast-data\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.984040 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.983897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fljkt\" (UniqueName: \"kubernetes.io/projected/c949c646-f295-49d9-8b5f-1dd32a430422-kube-api-access-fljkt\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.984040 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:43:19.983931    2577 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 08 11:43:19.984040 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.983937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-online-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.984040 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:43:19.984023    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls podName:c949c646-f295-49d9-8b5f-1dd32a430422 nodeName:}" failed. No retries permitted until 2026-09-08 11:43:20.484001838 +0000 UTC m=+553.500794629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls") pod "feast-simple-feast-remote-setup-5697bbcccd-xq6wk" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 08 11:43:19.984363 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.984344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c949c646-f295-49d9-8b5f-1dd32a430422-feast-data\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.984495 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.984472    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c949c646-f295-49d9-8b5f-1dd32a430422-registry-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.986325 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.986302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-offline-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.986413 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.986376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-online-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:19.991948 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:19.991929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fljkt\" (UniqueName: \"kubernetes.io/projected/c949c646-f295-49d9-8b5f-1dd32a430422-kube-api-access-fljkt\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:20.488380 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:20.488345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:20.490852 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:20.490820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls\") pod \"feast-simple-feast-remote-setup-5697bbcccd-xq6wk\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:20.713273 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:20.713233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:20.992899 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:20.992868    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"]
Sep 08 11:43:20.996128 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:43:20.996097    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc949c646_f295_49d9_8b5f_1dd32a430422.slice/crio-b59eea0b17e757a92f36bf9bcd8504507f8f8bd8e8efcec05e00d837ca58a31e WatchSource:0}: Error finding container b59eea0b17e757a92f36bf9bcd8504507f8f8bd8e8efcec05e00d837ca58a31e: Status 404 returned error can't find the container with id b59eea0b17e757a92f36bf9bcd8504507f8f8bd8e8efcec05e00d837ca58a31e
Sep 08 11:43:21.853373 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:21.853334    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerStarted","Data":"bcc1ce748ba7cbfd68a2db28d271231d303abece2e6f51d8a1d8b9506aacb822"}
Sep 08 11:43:21.853373 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:21.853379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerStarted","Data":"b59eea0b17e757a92f36bf9bcd8504507f8f8bd8e8efcec05e00d837ca58a31e"}
Sep 08 11:43:25.872412 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:25.872377    2577 generic.go:356] "Generic (PLEG): container finished" podID="c949c646-f295-49d9-8b5f-1dd32a430422" containerID="bcc1ce748ba7cbfd68a2db28d271231d303abece2e6f51d8a1d8b9506aacb822" exitCode=0
Sep 08 11:43:25.872866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:25.872453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerDied","Data":"bcc1ce748ba7cbfd68a2db28d271231d303abece2e6f51d8a1d8b9506aacb822"}
Sep 08 11:43:26.878758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:26.878722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerStarted","Data":"2991f8b7a7a71080faed7a581bbc67b4c07f7d154b606dcfc39f002611a25510"}
Sep 08 11:43:47.974020 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:47.973931    2577 generic.go:356] "Generic (PLEG): container finished" podID="c949c646-f295-49d9-8b5f-1dd32a430422" containerID="2991f8b7a7a71080faed7a581bbc67b4c07f7d154b606dcfc39f002611a25510" exitCode=0
Sep 08 11:43:47.974020 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:47.974002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerDied","Data":"2991f8b7a7a71080faed7a581bbc67b4c07f7d154b606dcfc39f002611a25510"}
Sep 08 11:43:48.983557 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:48.983514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerStarted","Data":"7fca62f72f6deb84447862209060a898ea66131906f9a7797030146779a636e0"}
Sep 08 11:43:48.984055 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:48.983592    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerStarted","Data":"6895706867a10c973e0bdbf9a5ebc494ee6f2f85e6dd69317dcb0a5bc50bb330"}
Sep 08 11:43:48.984055 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:48.983608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerStarted","Data":"df77300170d1f66af7c86821d7444c5a3b8fc6a79e32a6a7c89bfabb1622a580"}
Sep 08 11:43:49.008061 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:49.007993    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podStartSLOduration=30.007972926 podStartE2EDuration="30.007972926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:43:49.00625182 +0000 UTC m=+582.023044609" watchObservedRunningTime="2026-09-08 11:43:49.007972926 +0000 UTC m=+582.024765715"
Sep 08 11:43:50.713592 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.713537    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:50.714059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.713735    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:50.714059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.713763    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:50.714059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.713783    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:50.714059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.713797    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:50.714059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.713813    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:50.715516 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.715477    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 08 11:43:50.715516 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.715497    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Sep 08 11:43:50.715730 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:50.715536    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 08 11:43:53.713762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:53.713722    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 08 11:43:53.714262 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:53.713715    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 08 11:43:53.714262 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:53.713720    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
Sep 08 11:43:56.714851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:56.714816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:56.715422 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:56.714990    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:56.715645 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:56.715627    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:56.715726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:56.715672    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:56.741087 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:56.741056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:43:57.044983 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:43:57.044950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:44:07.392471 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:44:07.392441    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:44:07.394424 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:44:07.394401    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:45:00.087354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.087315    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"]
Sep 08 11:45:00.087892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.087613    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online" containerID="cri-o://df77300170d1f66af7c86821d7444c5a3b8fc6a79e32a6a7c89bfabb1622a580" gracePeriod=30
Sep 08 11:45:00.087892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.087682    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui" containerID="cri-o://7fca62f72f6deb84447862209060a898ea66131906f9a7797030146779a636e0" gracePeriod=30
Sep 08 11:45:00.087892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.087679    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="offline" containerID="cri-o://6895706867a10c973e0bdbf9a5ebc494ee6f2f85e6dd69317dcb0a5bc50bb330" gracePeriod=30
Sep 08 11:45:00.199057 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.199025    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"]
Sep 08 11:45:00.199520 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.199281    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="registry" containerID="cri-o://c9f1353820ba165cd5020407518228565bb1311c69237c95da2820bf4134272a" gracePeriod=30
Sep 08 11:45:00.199520 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.199353    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui" containerID="cri-o://ac7ae7cc363e9efd943ad923cccae0613dffb36f215540e2118c1ef6f14e37e9" gracePeriod=30
Sep 08 11:45:00.199520 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.199404    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="offline" containerID="cri-o://440c26ca002d97b15a1cdb3d873da543d9a417b76252bfc38178d50cbf0d2cb9" gracePeriod=30
Sep 08 11:45:00.199520 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:00.199349    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online" containerID="cri-o://5efd330e87bd5049b658211ee0bb1f034753149698aa012c17f45390c1114ca2" gracePeriod=30
Sep 08 11:45:01.282858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.282828    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerID="ac7ae7cc363e9efd943ad923cccae0613dffb36f215540e2118c1ef6f14e37e9" exitCode=0
Sep 08 11:45:01.282858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.282852    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerID="5efd330e87bd5049b658211ee0bb1f034753149698aa012c17f45390c1114ca2" exitCode=0
Sep 08 11:45:01.283326 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.282904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"ac7ae7cc363e9efd943ad923cccae0613dffb36f215540e2118c1ef6f14e37e9"}
Sep 08 11:45:01.283326 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.282950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"5efd330e87bd5049b658211ee0bb1f034753149698aa012c17f45390c1114ca2"}
Sep 08 11:45:01.285538 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.285512    2577 generic.go:356] "Generic (PLEG): container finished" podID="c949c646-f295-49d9-8b5f-1dd32a430422" containerID="7fca62f72f6deb84447862209060a898ea66131906f9a7797030146779a636e0" exitCode=0
Sep 08 11:45:01.285538 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.285535    2577 generic.go:356] "Generic (PLEG): container finished" podID="c949c646-f295-49d9-8b5f-1dd32a430422" containerID="df77300170d1f66af7c86821d7444c5a3b8fc6a79e32a6a7c89bfabb1622a580" exitCode=0
Sep 08 11:45:01.285716 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.285584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerDied","Data":"7fca62f72f6deb84447862209060a898ea66131906f9a7797030146779a636e0"}
Sep 08 11:45:01.285716 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:01.285624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerDied","Data":"df77300170d1f66af7c86821d7444c5a3b8fc6a79e32a6a7c89bfabb1622a580"}
Sep 08 11:45:06.715572 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:06.715526    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 08 11:45:07.023795 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:07.023703    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 08 11:45:07.590979 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:07.590939    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 08 11:45:07.591217 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:07.590945    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 08 11:45:16.716449 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:16.716400    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 08 11:45:17.023735 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:17.023644    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 08 11:45:17.591082 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:17.591040    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 08 11:45:17.591082 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:17.591056    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 08 11:45:26.715943 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:26.715898    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
Sep 08 11:45:26.716355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:26.716034    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:45:27.023743 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:27.023652    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 08 11:45:27.023900 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:27.023754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:45:27.591002 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:27.590962    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
Sep 08 11:45:27.591002 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:27.590976    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
Sep 08 11:45:27.591284 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:27.591085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:45:27.591284 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:27.591269    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:45:30.405151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.405071    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerID="440c26ca002d97b15a1cdb3d873da543d9a417b76252bfc38178d50cbf0d2cb9" exitCode=137
Sep 08 11:45:30.405151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.405097    2577 generic.go:356] "Generic (PLEG): container finished" podID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerID="c9f1353820ba165cd5020407518228565bb1311c69237c95da2820bf4134272a" exitCode=137
Sep 08 11:45:30.405653 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.405144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"440c26ca002d97b15a1cdb3d873da543d9a417b76252bfc38178d50cbf0d2cb9"}
Sep 08 11:45:30.405653 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.405195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"c9f1353820ba165cd5020407518228565bb1311c69237c95da2820bf4134272a"}
Sep 08 11:45:30.407911 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.407890    2577 generic.go:356] "Generic (PLEG): container finished" podID="c949c646-f295-49d9-8b5f-1dd32a430422" containerID="6895706867a10c973e0bdbf9a5ebc494ee6f2f85e6dd69317dcb0a5bc50bb330" exitCode=137
Sep 08 11:45:30.408025 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.407937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerDied","Data":"6895706867a10c973e0bdbf9a5ebc494ee6f2f85e6dd69317dcb0a5bc50bb330"}
Sep 08 11:45:30.735811 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.735785    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:45:30.765115 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765086    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c949c646-f295-49d9-8b5f-1dd32a430422-feast-data\") pod \"c949c646-f295-49d9-8b5f-1dd32a430422\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") "
Sep 08 11:45:30.765115 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765123    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls\") pod \"c949c646-f295-49d9-8b5f-1dd32a430422\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") "
Sep 08 11:45:30.765344 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765144    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-online-tls\") pod \"c949c646-f295-49d9-8b5f-1dd32a430422\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") "
Sep 08 11:45:30.765344 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765178    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fljkt\" (UniqueName: \"kubernetes.io/projected/c949c646-f295-49d9-8b5f-1dd32a430422-kube-api-access-fljkt\") pod \"c949c646-f295-49d9-8b5f-1dd32a430422\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") "
Sep 08 11:45:30.765344 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765219    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c949c646-f295-49d9-8b5f-1dd32a430422-registry-tls\") pod \"c949c646-f295-49d9-8b5f-1dd32a430422\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") "
Sep 08 11:45:30.765344 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765290    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-offline-tls\") pod \"c949c646-f295-49d9-8b5f-1dd32a430422\" (UID: \"c949c646-f295-49d9-8b5f-1dd32a430422\") "
Sep 08 11:45:30.765836 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.765789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c949c646-f295-49d9-8b5f-1dd32a430422-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c949c646-f295-49d9-8b5f-1dd32a430422" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:45:30.766111 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.766073    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c949c646-f295-49d9-8b5f-1dd32a430422-feast-data" (OuterVolumeSpecName: "feast-data") pod "c949c646-f295-49d9-8b5f-1dd32a430422" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:30.768814 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.768782    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c949c646-f295-49d9-8b5f-1dd32a430422" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.768892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.768805    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-online-tls" (OuterVolumeSpecName: "online-tls") pod "c949c646-f295-49d9-8b5f-1dd32a430422" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.768892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.768824    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c949c646-f295-49d9-8b5f-1dd32a430422" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.768892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.768851    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c949c646-f295-49d9-8b5f-1dd32a430422-kube-api-access-fljkt" (OuterVolumeSpecName: "kube-api-access-fljkt") pod "c949c646-f295-49d9-8b5f-1dd32a430422" (UID: "c949c646-f295-49d9-8b5f-1dd32a430422"). InnerVolumeSpecName "kube-api-access-fljkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:45:30.859169 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.859142    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:45:30.866645 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.866619    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c949c646-f295-49d9-8b5f-1dd32a430422-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:30.866645 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.866640    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:30.866645 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.866649    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:30.866901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.866657    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fljkt\" (UniqueName: \"kubernetes.io/projected/c949c646-f295-49d9-8b5f-1dd32a430422-kube-api-access-fljkt\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:30.866901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.866666    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c949c646-f295-49d9-8b5f-1dd32a430422-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:30.866901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.866674    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c949c646-f295-49d9-8b5f-1dd32a430422-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:30.967947 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.967861    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f66f86fa-5804-48fe-8eca-f52e0af7405b-feast-data\") pod \"f66f86fa-5804-48fe-8eca-f52e0af7405b\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") "
Sep 08 11:45:30.967947 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.967916    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-offline-tls\") pod \"f66f86fa-5804-48fe-8eca-f52e0af7405b\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") "
Sep 08 11:45:30.967947 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.967945    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-ui-tls\") pod \"f66f86fa-5804-48fe-8eca-f52e0af7405b\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") "
Sep 08 11:45:30.968235 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.967970    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-online-tls\") pod \"f66f86fa-5804-48fe-8eca-f52e0af7405b\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") "
Sep 08 11:45:30.968235 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.968011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg6sv\" (UniqueName: \"kubernetes.io/projected/f66f86fa-5804-48fe-8eca-f52e0af7405b-kube-api-access-sg6sv\") pod \"f66f86fa-5804-48fe-8eca-f52e0af7405b\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") "
Sep 08 11:45:30.968235 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.968050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls\") pod \"f66f86fa-5804-48fe-8eca-f52e0af7405b\" (UID: \"f66f86fa-5804-48fe-8eca-f52e0af7405b\") "
Sep 08 11:45:30.968467 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.968435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f66f86fa-5804-48fe-8eca-f52e0af7405b-feast-data" (OuterVolumeSpecName: "feast-data") pod "f66f86fa-5804-48fe-8eca-f52e0af7405b" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:45:30.970208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.970178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f66f86fa-5804-48fe-8eca-f52e0af7405b" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.970308 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.970207    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f66f86fa-5804-48fe-8eca-f52e0af7405b" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.970308 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.970223    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f66f86fa-5804-48fe-8eca-f52e0af7405b" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.970491 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.970463    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-online-tls" (OuterVolumeSpecName: "online-tls") pod "f66f86fa-5804-48fe-8eca-f52e0af7405b" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:45:30.970491 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:30.970477    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f66f86fa-5804-48fe-8eca-f52e0af7405b-kube-api-access-sg6sv" (OuterVolumeSpecName: "kube-api-access-sg6sv") pod "f66f86fa-5804-48fe-8eca-f52e0af7405b" (UID: "f66f86fa-5804-48fe-8eca-f52e0af7405b"). InnerVolumeSpecName "kube-api-access-sg6sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:45:31.068883 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.068852    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f66f86fa-5804-48fe-8eca-f52e0af7405b-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:31.068883 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.068880    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:31.068883 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.068889    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:31.069099 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.068897    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:31.069099 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.068905    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg6sv\" (UniqueName: \"kubernetes.io/projected/f66f86fa-5804-48fe-8eca-f52e0af7405b-kube-api-access-sg6sv\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:31.069099 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.068915    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f66f86fa-5804-48fe-8eca-f52e0af7405b-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:45:31.414632 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.414603    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"
Sep 08 11:45:31.414632 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.414612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk" event={"ID":"c949c646-f295-49d9-8b5f-1dd32a430422","Type":"ContainerDied","Data":"b59eea0b17e757a92f36bf9bcd8504507f8f8bd8e8efcec05e00d837ca58a31e"}
Sep 08 11:45:31.415166 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.414659    2577 scope.go:117] "RemoveContainer" containerID="7fca62f72f6deb84447862209060a898ea66131906f9a7797030146779a636e0"
Sep 08 11:45:31.417780 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.417753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27" event={"ID":"f66f86fa-5804-48fe-8eca-f52e0af7405b","Type":"ContainerDied","Data":"a3ebff4d0c12ec09257279f7c5da76eaba0f83081e48956a1a093715fb402e72"}
Sep 08 11:45:31.417900 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.417801    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"
Sep 08 11:45:31.423776 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.423735    2577 scope.go:117] "RemoveContainer" containerID="6895706867a10c973e0bdbf9a5ebc494ee6f2f85e6dd69317dcb0a5bc50bb330"
Sep 08 11:45:31.431669 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.431653    2577 scope.go:117] "RemoveContainer" containerID="df77300170d1f66af7c86821d7444c5a3b8fc6a79e32a6a7c89bfabb1622a580"
Sep 08 11:45:31.440286 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.440136    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"]
Sep 08 11:45:31.441884 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.441858    2577 scope.go:117] "RemoveContainer" containerID="2991f8b7a7a71080faed7a581bbc67b4c07f7d154b606dcfc39f002611a25510"
Sep 08 11:45:31.445682 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.445661    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5697bbcccd-xq6wk"]
Sep 08 11:45:31.449925 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.449911    2577 scope.go:117] "RemoveContainer" containerID="bcc1ce748ba7cbfd68a2db28d271231d303abece2e6f51d8a1d8b9506aacb822"
Sep 08 11:45:31.457339 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.457318    2577 scope.go:117] "RemoveContainer" containerID="ac7ae7cc363e9efd943ad923cccae0613dffb36f215540e2118c1ef6f14e37e9"
Sep 08 11:45:31.464466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.459649    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"]
Sep 08 11:45:31.465054 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.464583    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-7cd445644f-gxf27"]
Sep 08 11:45:31.466966 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.466947    2577 scope.go:117] "RemoveContainer" containerID="440c26ca002d97b15a1cdb3d873da543d9a417b76252bfc38178d50cbf0d2cb9"
Sep 08 11:45:31.474277 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.474258    2577 scope.go:117] "RemoveContainer" containerID="5efd330e87bd5049b658211ee0bb1f034753149698aa012c17f45390c1114ca2"
Sep 08 11:45:31.481653 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.481635    2577 scope.go:117] "RemoveContainer" containerID="c9f1353820ba165cd5020407518228565bb1311c69237c95da2820bf4134272a"
Sep 08 11:45:31.482990 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.482968    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" path="/var/lib/kubelet/pods/c949c646-f295-49d9-8b5f-1dd32a430422/volumes"
Sep 08 11:45:31.483476 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.483464    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" path="/var/lib/kubelet/pods/f66f86fa-5804-48fe-8eca-f52e0af7405b/volumes"
Sep 08 11:45:31.488815 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.488801    2577 scope.go:117] "RemoveContainer" containerID="64b4a70a23c5744c0732543b7db0b5a91ce659486d7a335a639d2210d3e9dea3"
Sep 08 11:45:31.495321 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:31.495305    2577 scope.go:117] "RemoveContainer" containerID="144695f15395ddb5aaf72af025dd5107ca1dcb3b1a4abacf48ba1044247e389e"
Sep 08 11:45:43.041975 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.041939    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-4lgsc"]
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042232    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="offline"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042243    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="offline"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042253    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="registry"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042259    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="registry"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042267    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="feast-apply"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042273    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="feast-apply"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042281    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042287    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042298    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042303    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042312    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="feast-init"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042317    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="feast-init"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042323    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="feast-init"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042328    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="feast-init"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042335    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="feast-apply"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042341    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="feast-apply"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042348    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042353    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042360    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="offline"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042365    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="offline"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042373    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042379    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042419    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="registry"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042428    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="ui"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042435    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="offline"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042442    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="ui"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042448    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="online"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042454    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f66f86fa-5804-48fe-8eca-f52e0af7405b" containerName="offline"
Sep 08 11:45:43.042464 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.042458    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c949c646-f295-49d9-8b5f-1dd32a430422" containerName="online"
Sep 08 11:45:43.045154 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.045134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.047655 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.047634    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 11:45:43.047789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.047699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 08 11:45:43.048209 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.048189    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 11:45:43.048589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.048575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-w6xnb\""
Sep 08 11:45:43.055083 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.055060    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-4lgsc"]
Sep 08 11:45:43.160959 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.160924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/247b3156-257e-47e4-8960-8eeb6ad5f00d-postgresdata\") pod \"postgres-864846d4f5-4lgsc\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") " pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.160959 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.160966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xhr\" (UniqueName: \"kubernetes.io/projected/247b3156-257e-47e4-8960-8eeb6ad5f00d-kube-api-access-64xhr\") pod \"postgres-864846d4f5-4lgsc\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") " pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.262039 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.261995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/247b3156-257e-47e4-8960-8eeb6ad5f00d-postgresdata\") pod \"postgres-864846d4f5-4lgsc\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") " pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.262231 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.262053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xhr\" (UniqueName: \"kubernetes.io/projected/247b3156-257e-47e4-8960-8eeb6ad5f00d-kube-api-access-64xhr\") pod \"postgres-864846d4f5-4lgsc\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") " pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.262391 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.262371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/247b3156-257e-47e4-8960-8eeb6ad5f00d-postgresdata\") pod \"postgres-864846d4f5-4lgsc\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") " pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.270360 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.270328    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xhr\" (UniqueName: \"kubernetes.io/projected/247b3156-257e-47e4-8960-8eeb6ad5f00d-kube-api-access-64xhr\") pod \"postgres-864846d4f5-4lgsc\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") " pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.363695 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.363596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:45:43.638259 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.638232    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-4lgsc"]
Sep 08 11:45:43.640523 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:45:43.640487    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod247b3156_257e_47e4_8960_8eeb6ad5f00d.slice/crio-67f730d59c8e8a5de4a32ee214173ea1041f22001f14ff5e9c529142db542fa7 WatchSource:0}: Error finding container 67f730d59c8e8a5de4a32ee214173ea1041f22001f14ff5e9c529142db542fa7: Status 404 returned error can't find the container with id 67f730d59c8e8a5de4a32ee214173ea1041f22001f14ff5e9c529142db542fa7
Sep 08 11:45:43.642244 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:43.642229    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:45:44.473142 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:44.473097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-4lgsc" event={"ID":"247b3156-257e-47e4-8960-8eeb6ad5f00d","Type":"ContainerStarted","Data":"67f730d59c8e8a5de4a32ee214173ea1041f22001f14ff5e9c529142db542fa7"}
Sep 08 11:45:49.495174 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:49.495140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-4lgsc" event={"ID":"247b3156-257e-47e4-8960-8eeb6ad5f00d","Type":"ContainerStarted","Data":"602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e"}
Sep 08 11:45:49.521493 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:49.521438    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-4lgsc" podStartSLOduration=1.339580324 podStartE2EDuration="6.521422545s" totalImagesPullingTime="5.181842221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:45:49.520794198 +0000 UTC m=+702.537586987" watchObservedRunningTime="2026-09-08 11:45:49.521422545 +0000 UTC m=+702.538215333"
Sep 08 11:45:53.940639 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.940597    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"]
Sep 08 11:45:53.946906 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.946876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:53.949075 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.949053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 08 11:45:53.949306 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.949290    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 08 11:45:53.949876 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.949859    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 08 11:45:53.950025 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.950007    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 08 11:45:53.950163 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.950148    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-k5zj7\""
Sep 08 11:45:53.964929 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:53.964902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"]
Sep 08 11:45:54.048613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.048548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6wz\" (UniqueName: \"kubernetes.io/projected/ff2ec998-37eb-4ceb-a358-6113a511b383-kube-api-access-zw6wz\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.048795 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.048626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-offline-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.048795 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.048659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec998-37eb-4ceb-a358-6113a511b383-feast-data\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.048795 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.048677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-online-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.048795 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.048700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-registry-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.149679 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.149627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-registry-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.149866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.149703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6wz\" (UniqueName: \"kubernetes.io/projected/ff2ec998-37eb-4ceb-a358-6113a511b383-kube-api-access-zw6wz\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.149866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.149728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-offline-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.149866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.149760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec998-37eb-4ceb-a358-6113a511b383-feast-data\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.149866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.149779    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-online-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.150236 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.150216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec998-37eb-4ceb-a358-6113a511b383-feast-data\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.152191 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.152167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-offline-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.152310 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.152196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-registry-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.152310 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.152273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-online-tls\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.158622 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.158596    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6wz\" (UniqueName: \"kubernetes.io/projected/ff2ec998-37eb-4ceb-a358-6113a511b383-kube-api-access-zw6wz\") pod \"feast-credit-scoring-8f8fb757f-tmv4k\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") " pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.256507 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.256404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:45:54.540309 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:54.540156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"]
Sep 08 11:45:54.543080 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:45:54.543053    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2ec998_37eb_4ceb_a358_6113a511b383.slice/crio-1c67e93e966135caece846ce85ec670ef5270f5da8767099bd1e23092e1fc661 WatchSource:0}: Error finding container 1c67e93e966135caece846ce85ec670ef5270f5da8767099bd1e23092e1fc661: Status 404 returned error can't find the container with id 1c67e93e966135caece846ce85ec670ef5270f5da8767099bd1e23092e1fc661
Sep 08 11:45:55.519772 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:55.519735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerStarted","Data":"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"}
Sep 08 11:45:55.520160 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:55.519805    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerStarted","Data":"1c67e93e966135caece846ce85ec670ef5270f5da8767099bd1e23092e1fc661"}
Sep 08 11:45:56.525473 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:56.525429    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerID="8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63" exitCode=0
Sep 08 11:45:56.525473 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:56.525473    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerDied","Data":"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"}
Sep 08 11:45:57.531306 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:45:57.531266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerStarted","Data":"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"}
Sep 08 11:46:03.559433 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:03.559399    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerID="10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47" exitCode=0
Sep 08 11:46:03.559842 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:03.559487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerDied","Data":"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"}
Sep 08 11:46:04.569028 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:04.568989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerStarted","Data":"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"}
Sep 08 11:46:04.569519 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:04.569052    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerStarted","Data":"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"}
Sep 08 11:46:04.569519 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:04.569071    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerStarted","Data":"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"}
Sep 08 11:46:04.598354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:04.598237    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podStartSLOduration=11.598213817 podStartE2EDuration="11.598213817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:46:04.595908937 +0000 UTC m=+717.612701739" watchObservedRunningTime="2026-09-08 11:46:04.598213817 +0000 UTC m=+717.615006617"
Sep 08 11:46:06.256904 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:06.256863    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:06.257379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:06.256940    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:06.257379 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:06.256971    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:06.258469 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:06.258433    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Sep 08 11:46:06.258469 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:06.258456    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Sep 08 11:46:06.258469 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:06.258472    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 08 11:46:09.257158 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:09.257107    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Sep 08 11:46:09.257660 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:09.257107    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Sep 08 11:46:09.257660 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:09.257137    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 08 11:46:12.257525 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:12.257476    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Sep 08 11:46:12.257934 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:12.257575    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 08 11:46:12.258498 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:12.258476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:12.258948 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:12.258925    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:12.259430 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:12.259409    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:14.257342 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:14.257294    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:14.257785 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:14.257424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:15.256813 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:15.256761    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Sep 08 11:46:15.264777 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:15.264745    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:15.627334 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:15.627290    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:18.258249 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:18.258210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:46:18.259106 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:46:18.259086    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:47:24.245585 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.245529    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"]
Sep 08 11:47:24.246156 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.245778    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry" containerID="cri-o://33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22" gracePeriod=30
Sep 08 11:47:24.246156 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.245892    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="offline" containerID="cri-o://60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093" gracePeriod=30
Sep 08 11:47:24.246156 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.245891    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" containerID="cri-o://b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4" gracePeriod=30
Sep 08 11:47:24.264134 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.264106    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-4lgsc"]
Sep 08 11:47:24.264294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.264279    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-4lgsc" podUID="247b3156-257e-47e4-8960-8eeb6ad5f00d" containerName="postgres" containerID="cri-o://602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e" gracePeriod=30
Sep 08 11:47:24.510095 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.510067    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:47:24.534062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.534020    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/247b3156-257e-47e4-8960-8eeb6ad5f00d-postgresdata\") pod \"247b3156-257e-47e4-8960-8eeb6ad5f00d\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") "
Sep 08 11:47:24.534232 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.534112    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64xhr\" (UniqueName: \"kubernetes.io/projected/247b3156-257e-47e4-8960-8eeb6ad5f00d-kube-api-access-64xhr\") pod \"247b3156-257e-47e4-8960-8eeb6ad5f00d\" (UID: \"247b3156-257e-47e4-8960-8eeb6ad5f00d\") "
Sep 08 11:47:24.536304 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.536268    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/247b3156-257e-47e4-8960-8eeb6ad5f00d-kube-api-access-64xhr" (OuterVolumeSpecName: "kube-api-access-64xhr") pod "247b3156-257e-47e4-8960-8eeb6ad5f00d" (UID: "247b3156-257e-47e4-8960-8eeb6ad5f00d"). InnerVolumeSpecName "kube-api-access-64xhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:47:24.566716 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.566663    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/247b3156-257e-47e4-8960-8eeb6ad5f00d-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "247b3156-257e-47e4-8960-8eeb6ad5f00d" (UID: "247b3156-257e-47e4-8960-8eeb6ad5f00d"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:24.634832 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.634796    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64xhr\" (UniqueName: \"kubernetes.io/projected/247b3156-257e-47e4-8960-8eeb6ad5f00d-kube-api-access-64xhr\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:24.634832 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.634825    2577 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/247b3156-257e-47e4-8960-8eeb6ad5f00d-postgresdata\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:24.907982 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.907945    2577 generic.go:356] "Generic (PLEG): container finished" podID="247b3156-257e-47e4-8960-8eeb6ad5f00d" containerID="602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e" exitCode=0
Sep 08 11:47:24.908187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.907995    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-4lgsc"
Sep 08 11:47:24.908187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.908025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-4lgsc" event={"ID":"247b3156-257e-47e4-8960-8eeb6ad5f00d","Type":"ContainerDied","Data":"602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e"}
Sep 08 11:47:24.908187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.908067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-4lgsc" event={"ID":"247b3156-257e-47e4-8960-8eeb6ad5f00d","Type":"ContainerDied","Data":"67f730d59c8e8a5de4a32ee214173ea1041f22001f14ff5e9c529142db542fa7"}
Sep 08 11:47:24.908187 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.908085    2577 scope.go:117] "RemoveContainer" containerID="602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e"
Sep 08 11:47:24.917226 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.917211    2577 scope.go:117] "RemoveContainer" containerID="602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e"
Sep 08 11:47:24.917489 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:47:24.917472    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e\": container with ID starting with 602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e not found: ID does not exist" containerID="602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e"
Sep 08 11:47:24.917540 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.917496    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e"} err="failed to get container status \"602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e\": rpc error: code = NotFound desc = could not find container \"602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e\": container with ID starting with 602e942989e51680945205689cd486c2a5afccb562797b3ccfc3e9392d1b7a9e not found: ID does not exist"
Sep 08 11:47:24.929095 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.929068    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-4lgsc"]
Sep 08 11:47:24.932769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:24.932746    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-4lgsc"]
Sep 08 11:47:25.481587 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:25.481488    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="247b3156-257e-47e4-8960-8eeb6ad5f00d" path="/var/lib/kubelet/pods/247b3156-257e-47e4-8960-8eeb6ad5f00d/volumes"
Sep 08 11:47:25.624159 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:25.624111    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 08 11:47:25.916028 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:25.915993    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerID="b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4" exitCode=0
Sep 08 11:47:25.916199 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:25.916049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerDied","Data":"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"}
Sep 08 11:47:35.623970 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:35.623880    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 08 11:47:45.624758 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:45.624716    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 08 11:47:45.625148 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:45.624841    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:47:54.899958 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.899930    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:47:54.988985 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.988946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-offline-tls\") pod \"ff2ec998-37eb-4ceb-a358-6113a511b383\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") "
Sep 08 11:47:54.989181 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.989003    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw6wz\" (UniqueName: \"kubernetes.io/projected/ff2ec998-37eb-4ceb-a358-6113a511b383-kube-api-access-zw6wz\") pod \"ff2ec998-37eb-4ceb-a358-6113a511b383\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") "
Sep 08 11:47:54.989181 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.989019    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-online-tls\") pod \"ff2ec998-37eb-4ceb-a358-6113a511b383\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") "
Sep 08 11:47:54.989181 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.989052    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-registry-tls\") pod \"ff2ec998-37eb-4ceb-a358-6113a511b383\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") "
Sep 08 11:47:54.989181 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.989132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec998-37eb-4ceb-a358-6113a511b383-feast-data\") pod \"ff2ec998-37eb-4ceb-a358-6113a511b383\" (UID: \"ff2ec998-37eb-4ceb-a358-6113a511b383\") "
Sep 08 11:47:54.991246 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.991213    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ff2ec998-37eb-4ceb-a358-6113a511b383" (UID: "ff2ec998-37eb-4ceb-a358-6113a511b383"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:47:54.991371 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.991272    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff2ec998-37eb-4ceb-a358-6113a511b383-kube-api-access-zw6wz" (OuterVolumeSpecName: "kube-api-access-zw6wz") pod "ff2ec998-37eb-4ceb-a358-6113a511b383" (UID: "ff2ec998-37eb-4ceb-a358-6113a511b383"). InnerVolumeSpecName "kube-api-access-zw6wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:47:54.991513 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.991494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-online-tls" (OuterVolumeSpecName: "online-tls") pod "ff2ec998-37eb-4ceb-a358-6113a511b383" (UID: "ff2ec998-37eb-4ceb-a358-6113a511b383"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:47:54.991559 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.991510    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff2ec998-37eb-4ceb-a358-6113a511b383" (UID: "ff2ec998-37eb-4ceb-a358-6113a511b383"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:47:54.997143 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:54.997114    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff2ec998-37eb-4ceb-a358-6113a511b383-feast-data" (OuterVolumeSpecName: "feast-data") pod "ff2ec998-37eb-4ceb-a358-6113a511b383" (UID: "ff2ec998-37eb-4ceb-a358-6113a511b383"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:47:55.032930 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.032898    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerID="60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093" exitCode=137
Sep 08 11:47:55.032930 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.032929    2577 generic.go:356] "Generic (PLEG): container finished" podID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerID="33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22" exitCode=137
Sep 08 11:47:55.033091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.032973    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"
Sep 08 11:47:55.033091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.032980    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerDied","Data":"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"}
Sep 08 11:47:55.033091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.033042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerDied","Data":"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"}
Sep 08 11:47:55.033091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.033062    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k" event={"ID":"ff2ec998-37eb-4ceb-a358-6113a511b383","Type":"ContainerDied","Data":"1c67e93e966135caece846ce85ec670ef5270f5da8767099bd1e23092e1fc661"}
Sep 08 11:47:55.033091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.033083    2577 scope.go:117] "RemoveContainer" containerID="60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"
Sep 08 11:47:55.041534 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.041515    2577 scope.go:117] "RemoveContainer" containerID="b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"
Sep 08 11:47:55.050396 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.050374    2577 scope.go:117] "RemoveContainer" containerID="33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"
Sep 08 11:47:55.054373 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.054351    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"]
Sep 08 11:47:55.057580 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.057541    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-8f8fb757f-tmv4k"]
Sep 08 11:47:55.059364 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.059350    2577 scope.go:117] "RemoveContainer" containerID="10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"
Sep 08 11:47:55.066704 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.066677    2577 scope.go:117] "RemoveContainer" containerID="8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"
Sep 08 11:47:55.073730 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.073714    2577 scope.go:117] "RemoveContainer" containerID="60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"
Sep 08 11:47:55.074010 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:47:55.073991    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093\": container with ID starting with 60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093 not found: ID does not exist" containerID="60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"
Sep 08 11:47:55.074062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074020    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"} err="failed to get container status \"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093\": rpc error: code = NotFound desc = could not find container \"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093\": container with ID starting with 60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093 not found: ID does not exist"
Sep 08 11:47:55.074062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074050    2577 scope.go:117] "RemoveContainer" containerID="b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"
Sep 08 11:47:55.074314 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:47:55.074296    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4\": container with ID starting with b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4 not found: ID does not exist" containerID="b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"
Sep 08 11:47:55.074350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074320    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"} err="failed to get container status \"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4\": rpc error: code = NotFound desc = could not find container \"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4\": container with ID starting with b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4 not found: ID does not exist"
Sep 08 11:47:55.074350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074337    2577 scope.go:117] "RemoveContainer" containerID="33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"
Sep 08 11:47:55.074627 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:47:55.074603    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22\": container with ID starting with 33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22 not found: ID does not exist" containerID="33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"
Sep 08 11:47:55.074675 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074636    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"} err="failed to get container status \"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22\": rpc error: code = NotFound desc = could not find container \"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22\": container with ID starting with 33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22 not found: ID does not exist"
Sep 08 11:47:55.074675 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074656    2577 scope.go:117] "RemoveContainer" containerID="10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"
Sep 08 11:47:55.074927 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:47:55.074910    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47\": container with ID starting with 10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47 not found: ID does not exist" containerID="10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"
Sep 08 11:47:55.075062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074932    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"} err="failed to get container status \"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47\": rpc error: code = NotFound desc = could not find container \"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47\": container with ID starting with 10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47 not found: ID does not exist"
Sep 08 11:47:55.075062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.074946    2577 scope.go:117] "RemoveContainer" containerID="8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"
Sep 08 11:47:55.075157 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:47:55.075143    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63\": container with ID starting with 8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63 not found: ID does not exist" containerID="8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"
Sep 08 11:47:55.075368 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075158    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"} err="failed to get container status \"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63\": rpc error: code = NotFound desc = could not find container \"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63\": container with ID starting with 8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63 not found: ID does not exist"
Sep 08 11:47:55.075368 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075169    2577 scope.go:117] "RemoveContainer" containerID="60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"
Sep 08 11:47:55.075368 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075341    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093"} err="failed to get container status \"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093\": rpc error: code = NotFound desc = could not find container \"60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093\": container with ID starting with 60ed8328001ca5ae1d8a01737e04021654a820e7a8d47098c97439c9bf109093 not found: ID does not exist"
Sep 08 11:47:55.075368 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075352    2577 scope.go:117] "RemoveContainer" containerID="b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"
Sep 08 11:47:55.075671 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075577    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4"} err="failed to get container status \"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4\": rpc error: code = NotFound desc = could not find container \"b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4\": container with ID starting with b74f859e1666058498cecb4c6255bca627dfce55c7e157875d8ba2dae60f7bc4 not found: ID does not exist"
Sep 08 11:47:55.075671 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075595    2577 scope.go:117] "RemoveContainer" containerID="33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"
Sep 08 11:47:55.075883 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075865    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22"} err="failed to get container status \"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22\": rpc error: code = NotFound desc = could not find container \"33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22\": container with ID starting with 33723b6649f7f2a3f4bfd6887dc7e988b03427be8bac3931568c3a414bbb7a22 not found: ID does not exist"
Sep 08 11:47:55.075883 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.075882    2577 scope.go:117] "RemoveContainer" containerID="10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"
Sep 08 11:47:55.076122 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.076104    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47"} err="failed to get container status \"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47\": rpc error: code = NotFound desc = could not find container \"10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47\": container with ID starting with 10c3ceeb3d132e3d7f4566dbb5f2a5df1c6e1a53d9a2317ec1a48f2484c6af47 not found: ID does not exist"
Sep 08 11:47:55.076165 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.076123    2577 scope.go:117] "RemoveContainer" containerID="8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"
Sep 08 11:47:55.076344 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.076327    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63"} err="failed to get container status \"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63\": rpc error: code = NotFound desc = could not find container \"8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63\": container with ID starting with 8077a9c628bc99385c17faf131e849e16b68ec9aae50b9c7def2634a2fa0ee63 not found: ID does not exist"
Sep 08 11:47:55.090773 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.090754    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw6wz\" (UniqueName: \"kubernetes.io/projected/ff2ec998-37eb-4ceb-a358-6113a511b383-kube-api-access-zw6wz\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:55.090851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.090792    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:55.090851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.090801    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:55.090851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.090809    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ff2ec998-37eb-4ceb-a358-6113a511b383-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:55.090851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.090818    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ff2ec998-37eb-4ceb-a358-6113a511b383-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:47:55.481693 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:47:55.481614    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" path="/var/lib/kubelet/pods/ff2ec998-37eb-4ceb-a358-6113a511b383/volumes"
Sep 08 11:49:07.415941 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:49:07.415857    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:49:07.418046 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:49:07.418016    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:50:00.146664 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146632    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-84x7g"]
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146951    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="247b3156-257e-47e4-8960-8eeb6ad5f00d" containerName="postgres"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146963    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="247b3156-257e-47e4-8960-8eeb6ad5f00d" containerName="postgres"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146974    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="feast-apply"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146979    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="feast-apply"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146989    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.146999    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147010    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147015    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147023    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="feast-init"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147028    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="feast-init"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147034    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="offline"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147039    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="offline"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147090    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="247b3156-257e-47e4-8960-8eeb6ad5f00d" containerName="postgres"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147098    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="registry"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147103    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="online"
Sep 08 11:50:00.148987 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.147107    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff2ec998-37eb-4ceb-a358-6113a511b383" containerName="offline"
Sep 08 11:50:00.149836 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.149816    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.152237 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.152214    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 08 11:50:00.152371 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.152349    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 08 11:50:00.152444 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.152430    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-9djjv\""
Sep 08 11:50:00.153061 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.153041    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 08 11:50:00.158793 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.158771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-84x7g"]
Sep 08 11:50:00.246279 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.246238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5b352c34-9618-49ad-a365-a703bb6aeee3-postgresdata\") pod \"postgres-864846d4f5-84x7g\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") " pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.246454 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.246321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfc94\" (UniqueName: \"kubernetes.io/projected/5b352c34-9618-49ad-a365-a703bb6aeee3-kube-api-access-bfc94\") pod \"postgres-864846d4f5-84x7g\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") " pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.347101 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.347063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfc94\" (UniqueName: \"kubernetes.io/projected/5b352c34-9618-49ad-a365-a703bb6aeee3-kube-api-access-bfc94\") pod \"postgres-864846d4f5-84x7g\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") " pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.347313 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.347124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5b352c34-9618-49ad-a365-a703bb6aeee3-postgresdata\") pod \"postgres-864846d4f5-84x7g\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") " pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.347530 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.347509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5b352c34-9618-49ad-a365-a703bb6aeee3-postgresdata\") pod \"postgres-864846d4f5-84x7g\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") " pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.355548 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.355524    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfc94\" (UniqueName: \"kubernetes.io/projected/5b352c34-9618-49ad-a365-a703bb6aeee3-kube-api-access-bfc94\") pod \"postgres-864846d4f5-84x7g\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") " pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.465755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.465667    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:50:00.737105 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:00.737028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-84x7g"]
Sep 08 11:50:00.740252 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:50:00.740224    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b352c34_9618_49ad_a365_a703bb6aeee3.slice/crio-b6638fc86788985e8f3715cd9470b022e58f8e3d79b5faaaf9c8cc407230340e WatchSource:0}: Error finding container b6638fc86788985e8f3715cd9470b022e58f8e3d79b5faaaf9c8cc407230340e: Status 404 returned error can't find the container with id b6638fc86788985e8f3715cd9470b022e58f8e3d79b5faaaf9c8cc407230340e
Sep 08 11:50:01.508552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:01.508521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g" event={"ID":"5b352c34-9618-49ad-a365-a703bb6aeee3","Type":"ContainerStarted","Data":"4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1"}
Sep 08 11:50:01.508552 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:01.508574    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g" event={"ID":"5b352c34-9618-49ad-a365-a703bb6aeee3","Type":"ContainerStarted","Data":"b6638fc86788985e8f3715cd9470b022e58f8e3d79b5faaaf9c8cc407230340e"}
Sep 08 11:50:01.532681 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:01.532617    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g" podStartSLOduration=1.532595126 podStartE2EDuration="1.532595126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:50:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:50:01.530918662 +0000 UTC m=+954.547711449" watchObservedRunningTime="2026-09-08 11:50:01.532595126 +0000 UTC m=+954.549387914"
Sep 08 11:50:05.709547 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.709510    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"]
Sep 08 11:50:05.712822 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.712805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.715089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.715060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 08 11:50:05.715235 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.715128    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 08 11:50:05.715235 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.715156    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 08 11:50:05.715235 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.715228    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-cjr8k\""
Sep 08 11:50:05.727594 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.727556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"]
Sep 08 11:50:05.791191 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.791157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.791370 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.791220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-registry-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.791370 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.791250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc6zf\" (UniqueName: \"kubernetes.io/projected/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-kube-api-access-nc6zf\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.791370 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.791277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-feast-data\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.891843 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.891805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-registry-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.891843 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.891844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc6zf\" (UniqueName: \"kubernetes.io/projected/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-kube-api-access-nc6zf\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.892071 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.891965    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-feast-data\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.892071 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.892027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.892208 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:50:05.892189    2577 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 08 11:50:05.892278 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:50:05.892268    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls podName:a75316e4-7da3-4a3c-82a6-d6faa3e7b709 nodeName:}" failed. No retries permitted until 2026-09-08 11:50:06.392245248 +0000 UTC m=+959.409038033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls") pod "feast-credit-scoring-674b7d56b9-wlsxb" (UID: "a75316e4-7da3-4a3c-82a6-d6faa3e7b709") : secret "feast-credit-scoring-online-tls" not found
Sep 08 11:50:05.892351 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.892332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-feast-data\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.894274 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.894251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-registry-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:05.902727 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:05.902697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc6zf\" (UniqueName: \"kubernetes.io/projected/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-kube-api-access-nc6zf\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:06.395452 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:06.395401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:06.397920 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:06.397888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls\") pod \"feast-credit-scoring-674b7d56b9-wlsxb\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") " pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:06.627508 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:06.627465    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:06.904849 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:06.904824    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"]
Sep 08 11:50:06.907044 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:50:06.907018    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75316e4_7da3_4a3c_82a6_d6faa3e7b709.slice/crio-c9cb9d5fda02469c83a4dca4f5d821d7380a37e8a6df244cdf98093de6ce06f8 WatchSource:0}: Error finding container c9cb9d5fda02469c83a4dca4f5d821d7380a37e8a6df244cdf98093de6ce06f8: Status 404 returned error can't find the container with id c9cb9d5fda02469c83a4dca4f5d821d7380a37e8a6df244cdf98093de6ce06f8
Sep 08 11:50:07.533720 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:07.533682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerStarted","Data":"cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d"}
Sep 08 11:50:07.533902 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:07.533739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerStarted","Data":"c9cb9d5fda02469c83a4dca4f5d821d7380a37e8a6df244cdf98093de6ce06f8"}
Sep 08 11:50:08.538994 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:08.538957    2577 generic.go:356] "Generic (PLEG): container finished" podID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerID="cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d" exitCode=0
Sep 08 11:50:08.539383 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:08.539038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerDied","Data":"cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d"}
Sep 08 11:50:09.550391 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:09.550352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerStarted","Data":"a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214"}
Sep 08 11:50:16.580854 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:16.580821    2577 generic.go:356] "Generic (PLEG): container finished" podID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerID="a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214" exitCode=0
Sep 08 11:50:16.581318 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:16.580904    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerDied","Data":"a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214"}
Sep 08 11:50:16.584122 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:16.584105    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 08 11:50:17.588489 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:17.588447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerStarted","Data":"371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2"}
Sep 08 11:50:17.589013 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:17.588534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerStarted","Data":"546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66"}
Sep 08 11:50:17.610874 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:17.610821    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podStartSLOduration=12.610808148 podStartE2EDuration="12.610808148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:50:17.610173896 +0000 UTC m=+970.626966695" watchObservedRunningTime="2026-09-08 11:50:17.610808148 +0000 UTC m=+970.627600935"
Sep 08 11:50:18.628683 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:18.628640    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:18.629188 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:18.628742    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:18.630416 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:18.630386    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 08 11:50:18.630416 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:18.630402    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 08 11:50:21.628842 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:21.628795    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 08 11:50:21.629332 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:21.628850    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 08 11:50:24.628171 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:24.628132    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 08 11:50:24.636531 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:24.636503    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:24.637009 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:24.636981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:24.640363 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:24.640315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:26.628302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:26.628267    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:27.628761 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:27.628721    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused"
Sep 08 11:50:30.628423 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:30.628342    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:30.629193 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:30.629171    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:50:31.550402 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.550368    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"]
Sep 08 11:50:31.555099 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.555081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.557646 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.557624    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 08 11:50:31.557770 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.557671    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 08 11:50:31.557770 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.557739    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-7mvw4\""
Sep 08 11:50:31.557770 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.557743    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 08 11:50:31.566514 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.566493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"]
Sep 08 11:50:31.721228 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.721189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9497eab-b670-42bc-a5ce-5e9cac1c32df-feast-data\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.721677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.721257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-online-tls\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.721677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.721284    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-registry-tls\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.721677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.721326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7nk\" (UniqueName: \"kubernetes.io/projected/f9497eab-b670-42bc-a5ce-5e9cac1c32df-kube-api-access-qx7nk\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.822302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.822221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7nk\" (UniqueName: \"kubernetes.io/projected/f9497eab-b670-42bc-a5ce-5e9cac1c32df-kube-api-access-qx7nk\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.822302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.822276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9497eab-b670-42bc-a5ce-5e9cac1c32df-feast-data\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.822543 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.822317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-online-tls\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.822543 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.822332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-registry-tls\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.822769 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.822747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9497eab-b670-42bc-a5ce-5e9cac1c32df-feast-data\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.824738 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.824718    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-online-tls\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.824840 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.824771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-registry-tls\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.829923 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.829903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7nk\" (UniqueName: \"kubernetes.io/projected/f9497eab-b670-42bc-a5ce-5e9cac1c32df-kube-api-access-qx7nk\") pod \"feast-driver-ranking-5f65cc7bbb-fwbkb\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") " pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:31.864576 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:31.864528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:32.142219 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:32.142112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"]
Sep 08 11:50:32.146734 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:50:32.146703    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9497eab_b670_42bc_a5ce_5e9cac1c32df.slice/crio-bcbef1b8556d27a36323f1316d2f09489d345c76ff30d264ce8270ae4b2e1cb8 WatchSource:0}: Error finding container bcbef1b8556d27a36323f1316d2f09489d345c76ff30d264ce8270ae4b2e1cb8: Status 404 returned error can't find the container with id bcbef1b8556d27a36323f1316d2f09489d345c76ff30d264ce8270ae4b2e1cb8
Sep 08 11:50:32.655466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:32.655430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerStarted","Data":"5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3"}
Sep 08 11:50:32.655784 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:32.655481    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerStarted","Data":"bcbef1b8556d27a36323f1316d2f09489d345c76ff30d264ce8270ae4b2e1cb8"}
Sep 08 11:50:37.677467 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:37.677432    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerID="5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3" exitCode=0
Sep 08 11:50:37.677467 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:37.677476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerDied","Data":"5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3"}
Sep 08 11:50:38.683418 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:38.683383    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerStarted","Data":"a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9"}
Sep 08 11:50:45.714909 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:45.714875    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerID="a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9" exitCode=0
Sep 08 11:50:45.715347 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:45.714933    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerDied","Data":"a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9"}
Sep 08 11:50:46.722322 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.722277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerStarted","Data":"b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5"}
Sep 08 11:50:46.722766 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.722355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerStarted","Data":"769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff"}
Sep 08 11:50:46.750871 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.750801    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podStartSLOduration=15.750779057999999 podStartE2EDuration="15.750779058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:50:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:50:46.749507316 +0000 UTC m=+999.766300104" watchObservedRunningTime="2026-09-08 11:50:46.750779058 +0000 UTC m=+999.767571847"
Sep 08 11:50:46.864995 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.864952    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:46.865165 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.865027    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:46.866727 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.866689    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 08 11:50:46.866845 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:46.866696    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 08 11:50:49.865123 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:49.865075    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 08 11:50:49.865527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:49.865156    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 08 11:50:51.865089 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:51.865050    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:51.865458 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:51.865130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:52.865931 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:52.865884    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 08 11:50:52.874628 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:52.874601    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:52.879376 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:52.879350    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:55.866006 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:55.865951    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused"
Sep 08 11:50:58.866267 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:58.866236    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:50:58.867011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:50:58.866992    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:52:21.200834 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:21.200751    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"]
Sep 08 11:52:21.201350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:21.200993    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry" containerID="cri-o://546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66" gracePeriod=30
Sep 08 11:52:21.201350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:21.201109    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online" containerID="cri-o://371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2" gracePeriod=30
Sep 08 11:52:21.213266 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:21.213232    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"]
Sep 08 11:52:21.213557 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:21.213532    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry" containerID="cri-o://769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff" gracePeriod=30
Sep 08 11:52:21.213642 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:21.213541    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online" containerID="cri-o://b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5" gracePeriod=30
Sep 08 11:52:22.131058 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:22.131031    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerID="b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5" exitCode=0
Sep 08 11:52:22.131185 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:22.131105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerDied","Data":"b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5"}
Sep 08 11:52:22.133424 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:22.133404    2577 generic.go:356] "Generic (PLEG): container finished" podID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerID="371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2" exitCode=0
Sep 08 11:52:22.133521 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:22.133457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerDied","Data":"371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2"}
Sep 08 11:52:22.875697 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:22.875651    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 08 11:52:23.610532 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.610497    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-84x7g"]
Sep 08 11:52:23.610726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.610706    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g" podUID="5b352c34-9618-49ad-a365-a703bb6aeee3" containerName="postgres" containerID="cri-o://4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1" gracePeriod=30
Sep 08 11:52:23.853671 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.853643    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:52:23.886163 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.886083    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfc94\" (UniqueName: \"kubernetes.io/projected/5b352c34-9618-49ad-a365-a703bb6aeee3-kube-api-access-bfc94\") pod \"5b352c34-9618-49ad-a365-a703bb6aeee3\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") "
Sep 08 11:52:23.886163 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.886142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5b352c34-9618-49ad-a365-a703bb6aeee3-postgresdata\") pod \"5b352c34-9618-49ad-a365-a703bb6aeee3\" (UID: \"5b352c34-9618-49ad-a365-a703bb6aeee3\") "
Sep 08 11:52:23.888661 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.888621    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b352c34-9618-49ad-a365-a703bb6aeee3-kube-api-access-bfc94" (OuterVolumeSpecName: "kube-api-access-bfc94") pod "5b352c34-9618-49ad-a365-a703bb6aeee3" (UID: "5b352c34-9618-49ad-a365-a703bb6aeee3"). InnerVolumeSpecName "kube-api-access-bfc94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:52:23.921409 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.921371    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b352c34-9618-49ad-a365-a703bb6aeee3-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "5b352c34-9618-49ad-a365-a703bb6aeee3" (UID: "5b352c34-9618-49ad-a365-a703bb6aeee3"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:52:23.987756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.987721    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfc94\" (UniqueName: \"kubernetes.io/projected/5b352c34-9618-49ad-a365-a703bb6aeee3-kube-api-access-bfc94\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:23.987756 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:23.987752    2577 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5b352c34-9618-49ad-a365-a703bb6aeee3-postgresdata\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:24.142044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.141958    2577 generic.go:356] "Generic (PLEG): container finished" podID="5b352c34-9618-49ad-a365-a703bb6aeee3" containerID="4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1" exitCode=0
Sep 08 11:52:24.142044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.141998    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g"
Sep 08 11:52:24.142044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.142011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g" event={"ID":"5b352c34-9618-49ad-a365-a703bb6aeee3","Type":"ContainerDied","Data":"4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1"}
Sep 08 11:52:24.142269 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.142050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-84x7g" event={"ID":"5b352c34-9618-49ad-a365-a703bb6aeee3","Type":"ContainerDied","Data":"b6638fc86788985e8f3715cd9470b022e58f8e3d79b5faaaf9c8cc407230340e"}
Sep 08 11:52:24.142269 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.142067    2577 scope.go:117] "RemoveContainer" containerID="4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1"
Sep 08 11:52:24.152501 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.152485    2577 scope.go:117] "RemoveContainer" containerID="4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1"
Sep 08 11:52:24.152809 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:24.152791    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1\": container with ID starting with 4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1 not found: ID does not exist" containerID="4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1"
Sep 08 11:52:24.152867 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.152818    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1"} err="failed to get container status \"4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1\": rpc error: code = NotFound desc = could not find container \"4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1\": container with ID starting with 4359130303e497e17d4bf360a558a1af4c74e4ce03b6ef37aaf3e6fd2b8740d1 not found: ID does not exist"
Sep 08 11:52:24.163596 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.163572    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-84x7g"]
Sep 08 11:52:24.166692 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.166672    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-84x7g"]
Sep 08 11:52:24.638076 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:24.638039    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 08 11:52:25.481648 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:25.481613    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b352c34-9618-49ad-a365-a703bb6aeee3" path="/var/lib/kubelet/pods/5b352c34-9618-49ad-a365-a703bb6aeee3/volumes"
Sep 08 11:52:32.876003 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:32.875955    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 08 11:52:34.637948 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:34.637898    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 08 11:52:42.875523 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:42.875480    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused"
Sep 08 11:52:42.875943 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:42.875636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:52:44.637819 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:44.637774    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 08 11:52:44.638292 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:44.637886    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:52:51.872851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:51.872827    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:52:51.875011 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:51.874996    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:52:52.023321 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023236    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls\") pod \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") "
Sep 08 11:52:52.023321 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx7nk\" (UniqueName: \"kubernetes.io/projected/f9497eab-b670-42bc-a5ce-5e9cac1c32df-kube-api-access-qx7nk\") pod \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") "
Sep 08 11:52:52.023321 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023318    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-registry-tls\") pod \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") "
Sep 08 11:52:52.023629 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023338    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc6zf\" (UniqueName: \"kubernetes.io/projected/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-kube-api-access-nc6zf\") pod \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") "
Sep 08 11:52:52.023629 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023357    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-registry-tls\") pod \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") "
Sep 08 11:52:52.023629 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023403    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-feast-data\") pod \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\" (UID: \"a75316e4-7da3-4a3c-82a6-d6faa3e7b709\") "
Sep 08 11:52:52.023629 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023424    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9497eab-b670-42bc-a5ce-5e9cac1c32df-feast-data\") pod \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") "
Sep 08 11:52:52.023629 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.023470    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-online-tls\") pod \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\" (UID: \"f9497eab-b670-42bc-a5ce-5e9cac1c32df\") "
Sep 08 11:52:52.024067 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.024030    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9497eab-b670-42bc-a5ce-5e9cac1c32df-feast-data" (OuterVolumeSpecName: "feast-data") pod "f9497eab-b670-42bc-a5ce-5e9cac1c32df" (UID: "f9497eab-b670-42bc-a5ce-5e9cac1c32df"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:52:52.025628 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.025601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9497eab-b670-42bc-a5ce-5e9cac1c32df-kube-api-access-qx7nk" (OuterVolumeSpecName: "kube-api-access-qx7nk") pod "f9497eab-b670-42bc-a5ce-5e9cac1c32df" (UID: "f9497eab-b670-42bc-a5ce-5e9cac1c32df"). InnerVolumeSpecName "kube-api-access-qx7nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:52:52.025825 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.025800    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls" (OuterVolumeSpecName: "online-tls") pod "a75316e4-7da3-4a3c-82a6-d6faa3e7b709" (UID: "a75316e4-7da3-4a3c-82a6-d6faa3e7b709"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:52:52.025937 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.025879    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f9497eab-b670-42bc-a5ce-5e9cac1c32df" (UID: "f9497eab-b670-42bc-a5ce-5e9cac1c32df"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:52:52.025937 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.025900    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a75316e4-7da3-4a3c-82a6-d6faa3e7b709" (UID: "a75316e4-7da3-4a3c-82a6-d6faa3e7b709"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:52:52.026116 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.026102    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-online-tls" (OuterVolumeSpecName: "online-tls") pod "f9497eab-b670-42bc-a5ce-5e9cac1c32df" (UID: "f9497eab-b670-42bc-a5ce-5e9cac1c32df"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:52:52.026354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.026327    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-kube-api-access-nc6zf" (OuterVolumeSpecName: "kube-api-access-nc6zf") pod "a75316e4-7da3-4a3c-82a6-d6faa3e7b709" (UID: "a75316e4-7da3-4a3c-82a6-d6faa3e7b709"). InnerVolumeSpecName "kube-api-access-nc6zf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:52:52.033313 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.033291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-feast-data" (OuterVolumeSpecName: "feast-data") pod "a75316e4-7da3-4a3c-82a6-d6faa3e7b709" (UID: "a75316e4-7da3-4a3c-82a6-d6faa3e7b709"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:52:52.125074 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125034    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx7nk\" (UniqueName: \"kubernetes.io/projected/f9497eab-b670-42bc-a5ce-5e9cac1c32df-kube-api-access-qx7nk\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125074 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125066    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125074 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125078    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc6zf\" (UniqueName: \"kubernetes.io/projected/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-kube-api-access-nc6zf\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125087    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125096    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125103    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f9497eab-b670-42bc-a5ce-5e9cac1c32df-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125131    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f9497eab-b670-42bc-a5ce-5e9cac1c32df-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.125366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.125140    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a75316e4-7da3-4a3c-82a6-d6faa3e7b709-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:52:52.259236 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.259201    2577 generic.go:356] "Generic (PLEG): container finished" podID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerID="769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff" exitCode=137
Sep 08 11:52:52.259468 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.259269    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"
Sep 08 11:52:52.259468 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.259285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerDied","Data":"769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff"}
Sep 08 11:52:52.259468 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.259333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb" event={"ID":"f9497eab-b670-42bc-a5ce-5e9cac1c32df","Type":"ContainerDied","Data":"bcbef1b8556d27a36323f1316d2f09489d345c76ff30d264ce8270ae4b2e1cb8"}
Sep 08 11:52:52.259468 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.259353    2577 scope.go:117] "RemoveContainer" containerID="b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5"
Sep 08 11:52:52.261726 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.261695    2577 generic.go:356] "Generic (PLEG): container finished" podID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerID="546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66" exitCode=137
Sep 08 11:52:52.261851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.261750    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"
Sep 08 11:52:52.261851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.261769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerDied","Data":"546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66"}
Sep 08 11:52:52.261851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.261819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb" event={"ID":"a75316e4-7da3-4a3c-82a6-d6faa3e7b709","Type":"ContainerDied","Data":"c9cb9d5fda02469c83a4dca4f5d821d7380a37e8a6df244cdf98093de6ce06f8"}
Sep 08 11:52:52.269478 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.269460    2577 scope.go:117] "RemoveContainer" containerID="769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff"
Sep 08 11:52:52.278358 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.278343    2577 scope.go:117] "RemoveContainer" containerID="a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9"
Sep 08 11:52:52.287157 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.286396    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"]
Sep 08 11:52:52.287543 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.287509    2577 scope.go:117] "RemoveContainer" containerID="5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3"
Sep 08 11:52:52.290838 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.290818    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5f65cc7bbb-fwbkb"]
Sep 08 11:52:52.295172 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.295156    2577 scope.go:117] "RemoveContainer" containerID="b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5"
Sep 08 11:52:52.295463 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.295445    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5\": container with ID starting with b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5 not found: ID does not exist" containerID="b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5"
Sep 08 11:52:52.295510 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.295471    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5"} err="failed to get container status \"b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5\": rpc error: code = NotFound desc = could not find container \"b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5\": container with ID starting with b0528045bb7e809e3252c4ab7e28a820154541a14f987e04a89923623f7e6ae5 not found: ID does not exist"
Sep 08 11:52:52.295510 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.295488    2577 scope.go:117] "RemoveContainer" containerID="769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff"
Sep 08 11:52:52.295771 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.295752    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff\": container with ID starting with 769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff not found: ID does not exist" containerID="769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff"
Sep 08 11:52:52.295818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.295776    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff"} err="failed to get container status \"769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff\": rpc error: code = NotFound desc = could not find container \"769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff\": container with ID starting with 769ff8f7a49313b34c65a3e41fce47cce982988badf7666f4c71a935a5a857ff not found: ID does not exist"
Sep 08 11:52:52.295818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.295791    2577 scope.go:117] "RemoveContainer" containerID="a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9"
Sep 08 11:52:52.296032 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.296011    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9\": container with ID starting with a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9 not found: ID does not exist" containerID="a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9"
Sep 08 11:52:52.296076 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.296038    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9"} err="failed to get container status \"a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9\": rpc error: code = NotFound desc = could not find container \"a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9\": container with ID starting with a9dd8786cb7a5a017497c14d12ba5480e916c1d7aa287b4ea8e9a8b78c01fab9 not found: ID does not exist"
Sep 08 11:52:52.296076 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.296053    2577 scope.go:117] "RemoveContainer" containerID="5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3"
Sep 08 11:52:52.296287 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.296270    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3\": container with ID starting with 5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3 not found: ID does not exist" containerID="5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3"
Sep 08 11:52:52.296357 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.296296    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3"} err="failed to get container status \"5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3\": rpc error: code = NotFound desc = could not find container \"5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3\": container with ID starting with 5834b727f45dae00f5588f25800b686855fe9b0f91b89c263716b39c00a77bb3 not found: ID does not exist"
Sep 08 11:52:52.296357 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.296318    2577 scope.go:117] "RemoveContainer" containerID="371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2"
Sep 08 11:52:52.301417 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.301398    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"]
Sep 08 11:52:52.303730 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.303710    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-674b7d56b9-wlsxb"]
Sep 08 11:52:52.304217 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.304197    2577 scope.go:117] "RemoveContainer" containerID="546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66"
Sep 08 11:52:52.311530 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.311513    2577 scope.go:117] "RemoveContainer" containerID="a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214"
Sep 08 11:52:52.318313 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.318295    2577 scope.go:117] "RemoveContainer" containerID="cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d"
Sep 08 11:52:52.325122 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.325105    2577 scope.go:117] "RemoveContainer" containerID="371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2"
Sep 08 11:52:52.325392 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.325374    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2\": container with ID starting with 371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2 not found: ID does not exist" containerID="371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2"
Sep 08 11:52:52.325473 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.325402    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2"} err="failed to get container status \"371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2\": rpc error: code = NotFound desc = could not find container \"371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2\": container with ID starting with 371bf50a7a29d195ad8dcf55b5c52c21ee7eee1dacddc00abad23394bbea65e2 not found: ID does not exist"
Sep 08 11:52:52.325473 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.325426    2577 scope.go:117] "RemoveContainer" containerID="546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66"
Sep 08 11:52:52.325706 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.325690    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66\": container with ID starting with 546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66 not found: ID does not exist" containerID="546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66"
Sep 08 11:52:52.325779 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.325713    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66"} err="failed to get container status \"546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66\": rpc error: code = NotFound desc = could not find container \"546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66\": container with ID starting with 546c3ca674c9482e1e378051174dacee6473984d66a62d989ca8b9c6fe5a0b66 not found: ID does not exist"
Sep 08 11:52:52.325779 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.325732    2577 scope.go:117] "RemoveContainer" containerID="a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214"
Sep 08 11:52:52.325993 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.325973    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214\": container with ID starting with a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214 not found: ID does not exist" containerID="a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214"
Sep 08 11:52:52.326062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.326000    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214"} err="failed to get container status \"a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214\": rpc error: code = NotFound desc = could not find container \"a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214\": container with ID starting with a86ef60e4b7181fcf85b948a51572c22747ae87853649456dddf3b84ca3f4214 not found: ID does not exist"
Sep 08 11:52:52.326062 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.326017    2577 scope.go:117] "RemoveContainer" containerID="cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d"
Sep 08 11:52:52.326276 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:52:52.326259    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d\": container with ID starting with cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d not found: ID does not exist" containerID="cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d"
Sep 08 11:52:52.326322 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:52.326282    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d"} err="failed to get container status \"cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d\": rpc error: code = NotFound desc = could not find container \"cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d\": container with ID starting with cd7d1bbc2c9ac8400219cc641c62b500236bee12c8525addfc1474e51b42225d not found: ID does not exist"
Sep 08 11:52:53.486119 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:53.486085    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" path="/var/lib/kubelet/pods/a75316e4-7da3-4a3c-82a6-d6faa3e7b709/volumes"
Sep 08 11:52:53.486598 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:53.486584    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" path="/var/lib/kubelet/pods/f9497eab-b670-42bc-a5ce-5e9cac1c32df/volumes"
Sep 08 11:52:57.463044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463010    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"]
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463295    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="feast-init"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463305    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="feast-init"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463319    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="feast-apply"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463325    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="feast-apply"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463333    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463338    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463343    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="feast-init"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463348    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="feast-init"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463352    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463357    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463363    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="feast-apply"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463367    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="feast-apply"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463373    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463377    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463408    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463413    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463423    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b352c34-9618-49ad-a365-a703bb6aeee3" containerName="postgres"
Sep 08 11:52:57.463437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463428    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b352c34-9618-49ad-a365-a703bb6aeee3" containerName="postgres"
Sep 08 11:52:57.464024 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463479    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="registry"
Sep 08 11:52:57.464024 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463487    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b352c34-9618-49ad-a365-a703bb6aeee3" containerName="postgres"
Sep 08 11:52:57.464024 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463492    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="online"
Sep 08 11:52:57.464024 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463496    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9497eab-b670-42bc-a5ce-5e9cac1c32df" containerName="online"
Sep 08 11:52:57.464024 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.463502    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75316e4-7da3-4a3c-82a6-d6faa3e7b709" containerName="registry"
Sep 08 11:52:57.469090 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.469072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.471298 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471269    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 08 11:52:57.471438 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471345    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 08 11:52:57.471438 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471348    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 11:52:57.471438 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471368    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 08 11:52:57.471438 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471355    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-f5hvb\""
Sep 08 11:52:57.471744 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471729    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 08 11:52:57.471785 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.471774    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 11:52:57.483115 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.483092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"]
Sep 08 11:52:57.567305 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.567268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.567313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.567358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12987338-a8a5-4d92-8262-878b9e8f3505-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.567382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.567469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.567509 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.567501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4pcs\" (UniqueName: \"kubernetes.io/projected/12987338-a8a5-4d92-8262-878b9e8f3505-kube-api-access-r4pcs\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668350 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668617 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12987338-a8a5-4d92-8262-878b9e8f3505-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668617 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668617 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668617 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4pcs\" (UniqueName: \"kubernetes.io/projected/12987338-a8a5-4d92-8262-878b9e8f3505-kube-api-access-r4pcs\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.668889 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.668868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12987338-a8a5-4d92-8262-878b9e8f3505-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.671110 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.671081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.671110 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.671098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.671261 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.671122    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.671261 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.671209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.675901 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.675877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4pcs\" (UniqueName: \"kubernetes.io/projected/12987338-a8a5-4d92-8262-878b9e8f3505-kube-api-access-r4pcs\") pod \"feast-simple-feast-setup-57576b8fcf-hz9rm\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:57.785738 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:57.785708    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:52:58.065818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:58.065701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"]
Sep 08 11:52:58.067982 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:52:58.067953    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12987338_a8a5_4d92_8262_878b9e8f3505.slice/crio-ce9633874c295a71f065c62101aa2855b56d50f5af22764044c7c6cd758e53f5 WatchSource:0}: Error finding container ce9633874c295a71f065c62101aa2855b56d50f5af22764044c7c6cd758e53f5: Status 404 returned error can't find the container with id ce9633874c295a71f065c62101aa2855b56d50f5af22764044c7c6cd758e53f5
Sep 08 11:52:58.069988 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:58.069974    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 11:52:58.287890 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:52:58.287856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"ce9633874c295a71f065c62101aa2855b56d50f5af22764044c7c6cd758e53f5"}
Sep 08 11:53:12.361808 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:12.361769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"e8ba63d0bea5c8eadabc01c27eeed12f70bc7260b3113b34a6416d2dc009f6ce"}
Sep 08 11:53:16.379066 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:16.379030    2577 generic.go:356] "Generic (PLEG): container finished" podID="12987338-a8a5-4d92-8262-878b9e8f3505" containerID="e8ba63d0bea5c8eadabc01c27eeed12f70bc7260b3113b34a6416d2dc009f6ce" exitCode=0
Sep 08 11:53:16.379550 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:16.379095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"e8ba63d0bea5c8eadabc01c27eeed12f70bc7260b3113b34a6416d2dc009f6ce"}
Sep 08 11:53:17.386097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:17.386057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"1748e7030c913787def3f84b534f70f6507c06448df17b42a431b2e84700ec21"}
Sep 08 11:53:23.412683 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:23.412647    2577 generic.go:356] "Generic (PLEG): container finished" podID="12987338-a8a5-4d92-8262-878b9e8f3505" containerID="1748e7030c913787def3f84b534f70f6507c06448df17b42a431b2e84700ec21" exitCode=0
Sep 08 11:53:23.413184 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:23.412719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"1748e7030c913787def3f84b534f70f6507c06448df17b42a431b2e84700ec21"}
Sep 08 11:53:24.422996 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.422950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"dced5759430a90d749911e9a9b63b44696172318937f955378b2288c737d4d89"}
Sep 08 11:53:24.423494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.423019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"d88e03a18aeb00c457fbfda8a219d786145074f5703d013b9713587fc243f429"}
Sep 08 11:53:24.423494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.423042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"139d23cfaffed15d17d1bf468258249374ddd4e062de57f7e6d443f8e9704b2a"}
Sep 08 11:53:24.423494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.423059    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerStarted","Data":"ce912529189fc4f45b7208ad80f952b78d8a98d749a50e7fb43d631d7cb5a477"}
Sep 08 11:53:24.449888 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.449815    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podStartSLOduration=14.203732956 podStartE2EDuration="27.449792758s" totalImagesPullingTime="13.246059802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:53:24.448917728 +0000 UTC m=+1157.465710534" watchObservedRunningTime="2026-09-08 11:53:24.449792758 +0000 UTC m=+1157.466585550"
Sep 08 11:53:24.786333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.786289    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:24.786546 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.786360    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:24.786546 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.786382    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:24.786546 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.786400    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:24.788803 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.788758    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 08 11:53:24.788803 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.788784    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 08 11:53:24.789013 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.788814    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 08 11:53:24.789013 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:24.788862    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Sep 08 11:53:27.786236 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.785818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:27.786755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786265    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:27.786755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786276    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 08 11:53:27.786755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786183    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 08 11:53:27.786755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:27.786755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786146    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Sep 08 11:53:27.786755 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786013    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 08 11:53:27.787103 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:27.786828    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:30.787097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:30.786889    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 08 11:53:30.787097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:30.786912    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Sep 08 11:53:30.787097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:30.786882    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 08 11:53:30.787742 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:30.787111    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 08 11:53:33.787881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.787844    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:33.788402 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.787987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:33.788402 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.788201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:33.788736 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.788711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:33.788994 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.788978    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:33.789057 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.789038    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:33.793082 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:33.793062    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:53:34.490501 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:53:34.490471    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:54:07.440794 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:07.440765    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:54:07.444342 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:07.444319    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:54:36.846877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:36.846843    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"]
Sep 08 11:54:36.847333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:36.847086    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry" containerID="cri-o://ce912529189fc4f45b7208ad80f952b78d8a98d749a50e7fb43d631d7cb5a477" gracePeriod=30
Sep 08 11:54:36.847333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:36.847134    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" containerID="cri-o://dced5759430a90d749911e9a9b63b44696172318937f955378b2288c737d4d89" gracePeriod=30
Sep 08 11:54:36.847333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:36.847160    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline" containerID="cri-o://d88e03a18aeb00c457fbfda8a219d786145074f5703d013b9713587fc243f429" gracePeriod=30
Sep 08 11:54:36.847333 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:36.847194    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" containerID="cri-o://139d23cfaffed15d17d1bf468258249374ddd4e062de57f7e6d443f8e9704b2a" gracePeriod=30
Sep 08 11:54:37.253990 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.253902    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"]
Sep 08 11:54:37.257632 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.257612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.259958 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.259927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8jbtb\""
Sep 08 11:54:37.274203 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.274170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"]
Sep 08 11:54:37.287223 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.287189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.287402 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.287235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed129cd-5661-4c16-aa30-f98aaddaa044-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.287402 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.287344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.287533 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.287396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mn5c\" (UniqueName: \"kubernetes.io/projected/6ed129cd-5661-4c16-aa30-f98aaddaa044-kube-api-access-5mn5c\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.287533 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.287466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.287533 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.287509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.388653 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.388606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.388877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.388679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed129cd-5661-4c16-aa30-f98aaddaa044-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.388877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.388732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.388877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.388760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mn5c\" (UniqueName: \"kubernetes.io/projected/6ed129cd-5661-4c16-aa30-f98aaddaa044-kube-api-access-5mn5c\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.388877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.388807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.388877 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.388836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.391290 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:54:37.391046    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 08 11:54:37.391290 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:54:37.391143    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls podName:6ed129cd-5661-4c16-aa30-f98aaddaa044 nodeName:}" failed. No retries permitted until 2026-09-08 11:54:37.891119787 +0000 UTC m=+1230.907912573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls") pod "feast-simple-feast-setup-57576b8fcf-sg4dq" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044") : secret "feast-simple-feast-setup-online-tls" not found
Sep 08 11:54:37.391917 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.391893    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed129cd-5661-4c16-aa30-f98aaddaa044-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.392452 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.392428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.393522 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.393489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.393661 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.393643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.398851 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.398822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mn5c\" (UniqueName: \"kubernetes.io/projected/6ed129cd-5661-4c16-aa30-f98aaddaa044-kube-api-access-5mn5c\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.736849 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.736813    2577 generic.go:356] "Generic (PLEG): container finished" podID="12987338-a8a5-4d92-8262-878b9e8f3505" containerID="dced5759430a90d749911e9a9b63b44696172318937f955378b2288c737d4d89" exitCode=0
Sep 08 11:54:37.737044 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.736893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"dced5759430a90d749911e9a9b63b44696172318937f955378b2288c737d4d89"}
Sep 08 11:54:37.894965 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.894849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:37.897316 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:37.897287    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sg4dq\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:38.175700 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:38.175599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:38.455353 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:38.455327    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"]
Sep 08 11:54:38.457043 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:54:38.457007    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ed129cd_5661_4c16_aa30_f98aaddaa044.slice/crio-96c5bf2ff4813560d551861d2325a8774037317731f40efe533e40cffe9a58d0 WatchSource:0}: Error finding container 96c5bf2ff4813560d551861d2325a8774037317731f40efe533e40cffe9a58d0: Status 404 returned error can't find the container with id 96c5bf2ff4813560d551861d2325a8774037317731f40efe533e40cffe9a58d0
Sep 08 11:54:38.745704 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:38.745603    2577 generic.go:356] "Generic (PLEG): container finished" podID="12987338-a8a5-4d92-8262-878b9e8f3505" containerID="139d23cfaffed15d17d1bf468258249374ddd4e062de57f7e6d443f8e9704b2a" exitCode=0
Sep 08 11:54:38.745885 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:38.745775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"139d23cfaffed15d17d1bf468258249374ddd4e062de57f7e6d443f8e9704b2a"}
Sep 08 11:54:38.747422 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:38.747327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"50c321efe8a1cb94ad216299d3f09d1b9019cf37da72f7f344be4dd3cecc3cf9"}
Sep 08 11:54:38.747422 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:38.747370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"96c5bf2ff4813560d551861d2325a8774037317731f40efe533e40cffe9a58d0"}
Sep 08 11:54:43.769477 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:43.769441    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerID="50c321efe8a1cb94ad216299d3f09d1b9019cf37da72f7f344be4dd3cecc3cf9" exitCode=0
Sep 08 11:54:43.769883 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:43.769514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"50c321efe8a1cb94ad216299d3f09d1b9019cf37da72f7f344be4dd3cecc3cf9"}
Sep 08 11:54:43.788675 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:43.788644    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 08 11:54:44.488263 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:44.488220    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 08 11:54:44.775112 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:44.775018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"c51327ebbd340d4112543bd54d40b0f6713c4d63379d84321230347d3c06f92c"}
Sep 08 11:54:50.803879 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:50.803845    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerID="c51327ebbd340d4112543bd54d40b0f6713c4d63379d84321230347d3c06f92c" exitCode=0
Sep 08 11:54:50.804276 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:50.803920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"c51327ebbd340d4112543bd54d40b0f6713c4d63379d84321230347d3c06f92c"}
Sep 08 11:54:51.814312 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:51.814270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"0ef5b17891d05583a6e2c199759708b4af0aa081cea9e02c1477b155e491b2cb"}
Sep 08 11:54:51.814840 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:51.814339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"76e8cb9c4f1f71773fddf32e6ce75de72b304baa1e149bc9a07de699e4b639fe"}
Sep 08 11:54:51.814840 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:51.814364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"c2d222d1ac309302482804b6cd0e5709b8d795a0b0ed06b8675f9841717af92f"}
Sep 08 11:54:51.814840 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:51.814381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerStarted","Data":"03a15e52ff647ed3bd705b24fe7ed76a66d1e34736d69a5820218893b5958c2b"}
Sep 08 11:54:51.838706 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:51.838640    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podStartSLOduration=14.838616144 podStartE2EDuration="14.838616144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:54:51.837300884 +0000 UTC m=+1244.854093679" watchObservedRunningTime="2026-09-08 11:54:51.838616144 +0000 UTC m=+1244.855408933"
Sep 08 11:54:53.176416 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.176379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:53.177581 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.176996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:53.177581 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.177027    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:53.177581 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.177047    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:53.178585 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.178536    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 08 11:54:53.178826 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.178579    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 08 11:54:53.179006 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.178640    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 08 11:54:53.179128 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.178696    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 08 11:54:53.789694 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:53.789616    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 08 11:54:54.488039 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:54.487986    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 08 11:54:56.176110 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:56.176049    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 08 11:54:56.176605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:56.176048    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 08 11:54:56.176605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:56.176058    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 08 11:54:56.176605 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:56.176069    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 08 11:54:58.176677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:58.176623    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:58.177174 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:58.176694    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:58.177174 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:58.176713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:58.177174 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:58.176734    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:59.176360 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.176311    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 08 11:54:59.177273 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.177243    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:59.177641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.177409    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:59.178165 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.178137    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:59.178389 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.178372    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:59.182588 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.182557    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:54:59.866644 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:54:59.866613    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:55:02.177512 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:02.177481    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:55:02.876190 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:02.876160    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:55:03.788878 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:03.788830    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 08 11:55:03.789371 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:03.788974    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:55:04.487739 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:04.487698    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 08 11:55:04.487951 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:04.487824    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:55:06.893962 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:06.893932    2577 generic.go:356] "Generic (PLEG): container finished" podID="12987338-a8a5-4d92-8262-878b9e8f3505" containerID="d88e03a18aeb00c457fbfda8a219d786145074f5703d013b9713587fc243f429" exitCode=137
Sep 08 11:55:06.893962 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:06.893958    2577 generic.go:356] "Generic (PLEG): container finished" podID="12987338-a8a5-4d92-8262-878b9e8f3505" containerID="ce912529189fc4f45b7208ad80f952b78d8a98d749a50e7fb43d631d7cb5a477" exitCode=137
Sep 08 11:55:06.894346 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:06.894003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"d88e03a18aeb00c457fbfda8a219d786145074f5703d013b9713587fc243f429"}
Sep 08 11:55:06.894346 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:06.894049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"ce912529189fc4f45b7208ad80f952b78d8a98d749a50e7fb43d631d7cb5a477"}
Sep 08 11:55:07.498477 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.498450    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:55:07.562735 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.562699    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-offline-tls\") pod \"12987338-a8a5-4d92-8262-878b9e8f3505\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") "
Sep 08 11:55:07.562898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.562780    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-online-tls\") pod \"12987338-a8a5-4d92-8262-878b9e8f3505\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") "
Sep 08 11:55:07.562898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.562802    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-ui-tls\") pod \"12987338-a8a5-4d92-8262-878b9e8f3505\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") "
Sep 08 11:55:07.562898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.562822    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12987338-a8a5-4d92-8262-878b9e8f3505-feast-data\") pod \"12987338-a8a5-4d92-8262-878b9e8f3505\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") "
Sep 08 11:55:07.562898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.562844    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4pcs\" (UniqueName: \"kubernetes.io/projected/12987338-a8a5-4d92-8262-878b9e8f3505-kube-api-access-r4pcs\") pod \"12987338-a8a5-4d92-8262-878b9e8f3505\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") "
Sep 08 11:55:07.562898 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.562880    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-registry-tls\") pod \"12987338-a8a5-4d92-8262-878b9e8f3505\" (UID: \"12987338-a8a5-4d92-8262-878b9e8f3505\") "
Sep 08 11:55:07.563494 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.563453    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12987338-a8a5-4d92-8262-878b9e8f3505-feast-data" (OuterVolumeSpecName: "feast-data") pod "12987338-a8a5-4d92-8262-878b9e8f3505" (UID: "12987338-a8a5-4d92-8262-878b9e8f3505"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:55:07.565166 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.565132    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-online-tls" (OuterVolumeSpecName: "online-tls") pod "12987338-a8a5-4d92-8262-878b9e8f3505" (UID: "12987338-a8a5-4d92-8262-878b9e8f3505"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:55:07.565294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.565190    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12987338-a8a5-4d92-8262-878b9e8f3505-kube-api-access-r4pcs" (OuterVolumeSpecName: "kube-api-access-r4pcs") pod "12987338-a8a5-4d92-8262-878b9e8f3505" (UID: "12987338-a8a5-4d92-8262-878b9e8f3505"). InnerVolumeSpecName "kube-api-access-r4pcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:55:07.565294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.565211    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "12987338-a8a5-4d92-8262-878b9e8f3505" (UID: "12987338-a8a5-4d92-8262-878b9e8f3505"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:55:07.565411 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.565308    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "12987338-a8a5-4d92-8262-878b9e8f3505" (UID: "12987338-a8a5-4d92-8262-878b9e8f3505"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:55:07.565411 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.565398    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "12987338-a8a5-4d92-8262-878b9e8f3505" (UID: "12987338-a8a5-4d92-8262-878b9e8f3505"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:55:07.664388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.664297    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/12987338-a8a5-4d92-8262-878b9e8f3505-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:55:07.664388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.664329    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4pcs\" (UniqueName: \"kubernetes.io/projected/12987338-a8a5-4d92-8262-878b9e8f3505-kube-api-access-r4pcs\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:55:07.664388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.664339    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:55:07.664388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.664347    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:55:07.664388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.664355    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:55:07.664388 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.664365    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/12987338-a8a5-4d92-8262-878b9e8f3505-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:55:07.900876 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.900839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm" event={"ID":"12987338-a8a5-4d92-8262-878b9e8f3505","Type":"ContainerDied","Data":"ce9633874c295a71f065c62101aa2855b56d50f5af22764044c7c6cd758e53f5"}
Sep 08 11:55:07.901349 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.900892    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"
Sep 08 11:55:07.901349 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.900903    2577 scope.go:117] "RemoveContainer" containerID="dced5759430a90d749911e9a9b63b44696172318937f955378b2288c737d4d89"
Sep 08 11:55:07.909806 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.909789    2577 scope.go:117] "RemoveContainer" containerID="d88e03a18aeb00c457fbfda8a219d786145074f5703d013b9713587fc243f429"
Sep 08 11:55:07.917778 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.917757    2577 scope.go:117] "RemoveContainer" containerID="139d23cfaffed15d17d1bf468258249374ddd4e062de57f7e6d443f8e9704b2a"
Sep 08 11:55:07.921838 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.921813    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"]
Sep 08 11:55:07.924885 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.924861    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-hz9rm"]
Sep 08 11:55:07.926174 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.926154    2577 scope.go:117] "RemoveContainer" containerID="ce912529189fc4f45b7208ad80f952b78d8a98d749a50e7fb43d631d7cb5a477"
Sep 08 11:55:07.933928 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.933910    2577 scope.go:117] "RemoveContainer" containerID="1748e7030c913787def3f84b534f70f6507c06448df17b42a431b2e84700ec21"
Sep 08 11:55:07.941320 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:07.941299    2577 scope.go:117] "RemoveContainer" containerID="e8ba63d0bea5c8eadabc01c27eeed12f70bc7260b3113b34a6416d2dc009f6ce"
Sep 08 11:55:09.482240 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:55:09.482205    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" path="/var/lib/kubelet/pods/12987338-a8a5-4d92-8262-878b9e8f3505/volumes"
Sep 08 11:56:06.346955 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.346917    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"]
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347205    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347216    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347229    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="feast-init"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347235    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="feast-init"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347242    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347248    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347263    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347268    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347274    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="feast-apply"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347281    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="feast-apply"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347287    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347292    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347341    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="online"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347349    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="ui"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347356    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="registry"
Sep 08 11:56:06.347432 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.347363    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12987338-a8a5-4d92-8262-878b9e8f3505" containerName="offline"
Sep 08 11:56:06.350533 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.350514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.352725 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.352699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 08 11:56:06.352855 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.352834    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 08 11:56:06.352918 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.352836    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-xtvmf\""
Sep 08 11:56:06.352918 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.352857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 08 11:56:06.353039 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.352936    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 08 11:56:06.353039 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.352973    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 08 11:56:06.353920 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.353902    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 08 11:56:06.362621 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.362600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"]
Sep 08 11:56:06.450283 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.450245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f1322ccc-8890-47f3-8b85-77ba42da1ef6-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.450472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.450299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.450472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.450336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1322ccc-8890-47f3-8b85-77ba42da1ef6-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.450472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.450361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.450472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.450389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r49m9\" (UniqueName: \"kubernetes.io/projected/f1322ccc-8890-47f3-8b85-77ba42da1ef6-kube-api-access-r49m9\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.450472 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.450430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551042 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551042 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1322ccc-8890-47f3-8b85-77ba42da1ef6-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551322 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551322 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r49m9\" (UniqueName: \"kubernetes.io/projected/f1322ccc-8890-47f3-8b85-77ba42da1ef6-kube-api-access-r49m9\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551322 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551322 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f1322ccc-8890-47f3-8b85-77ba42da1ef6-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.551545 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551475    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1322ccc-8890-47f3-8b85-77ba42da1ef6-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.552000 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.551975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f1322ccc-8890-47f3-8b85-77ba42da1ef6-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.553663 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.553634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.553825 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.553803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.553892 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.553805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.561723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.561698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r49m9\" (UniqueName: \"kubernetes.io/projected/f1322ccc-8890-47f3-8b85-77ba42da1ef6-kube-api-access-r49m9\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-2c9k8\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.660273 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.660188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:06.937881 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:06.937856    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"]
Sep 08 11:56:06.940346 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:56:06.940316    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1322ccc_8890_47f3_8b85_77ba42da1ef6.slice/crio-170778ba0f84250bf14550107fa7fa904ccbf4f8b963f9de479eef9fd2d4152e WatchSource:0}: Error finding container 170778ba0f84250bf14550107fa7fa904ccbf4f8b963f9de479eef9fd2d4152e: Status 404 returned error can't find the container with id 170778ba0f84250bf14550107fa7fa904ccbf4f8b963f9de479eef9fd2d4152e
Sep 08 11:56:07.133910 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:07.133866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerStarted","Data":"44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b"}
Sep 08 11:56:07.134122 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:07.133929    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerStarted","Data":"170778ba0f84250bf14550107fa7fa904ccbf4f8b963f9de479eef9fd2d4152e"}
Sep 08 11:56:12.154043 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:12.154006    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerID="44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b" exitCode=0
Sep 08 11:56:12.154485 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:12.154079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerDied","Data":"44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b"}
Sep 08 11:56:13.160777 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:13.160741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerStarted","Data":"b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99"}
Sep 08 11:56:34.247688 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:34.247656    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerID="b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99" exitCode=0
Sep 08 11:56:34.248071 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:34.247698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerDied","Data":"b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99"}
Sep 08 11:56:35.257437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:35.257400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerStarted","Data":"cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d"}
Sep 08 11:56:35.257437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:35.257446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerStarted","Data":"5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6"}
Sep 08 11:56:35.257990 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:35.257459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerStarted","Data":"b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73"}
Sep 08 11:56:35.281225 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:35.281157    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podStartSLOduration=29.281133645 podStartE2EDuration="29.281133645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:56:35.279433631 +0000 UTC m=+1348.296226420" watchObservedRunningTime="2026-09-08 11:56:35.281133645 +0000 UTC m=+1348.297926434"
Sep 08 11:56:36.660906 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.660860    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:36.662019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.660930    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:36.662019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.660994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:36.662019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.661369    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:36.662019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.661407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:36.662019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.661427    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:36.663083 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.663053    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 08 11:56:36.663208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.663092    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 08 11:56:36.663208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:36.663135    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 08 11:56:39.661295 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:39.661249    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 08 11:56:39.661866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:39.661316    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 08 11:56:39.661866 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:39.661262    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 08 11:56:42.661242 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:42.661186    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 08 11:56:42.661666 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:42.661240    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 08 11:56:42.662276 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:42.662254    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:42.663190 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:42.663169    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:45.661502 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:45.661470    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:45.662488 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:45.662467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:46.351192 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:46.351159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:47.379914 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:47.379877    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:56:47.665802 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:47.665699    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 08 11:56:48.384742 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:56:48.384694    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 11:57:48.908626 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:48.908587    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"]
Sep 08 11:57:48.909173 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:48.908871    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" containerID="cri-o://b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73" gracePeriod=30
Sep 08 11:57:48.909173 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:48.908969    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" containerID="cri-o://cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d" gracePeriod=30
Sep 08 11:57:48.909173 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:48.908964    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="offline" containerID="cri-o://5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6" gracePeriod=30
Sep 08 11:57:49.101686 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:49.101654    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"]
Sep 08 11:57:49.101948 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:49.101919    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry" containerID="cri-o://03a15e52ff647ed3bd705b24fe7ed76a66d1e34736d69a5820218893b5958c2b" gracePeriod=30
Sep 08 11:57:49.102175 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:49.102035    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline" containerID="cri-o://76e8cb9c4f1f71773fddf32e6ce75de72b304baa1e149bc9a07de699e4b639fe" gracePeriod=30
Sep 08 11:57:49.102175 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:49.102070    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online" containerID="cri-o://c2d222d1ac309302482804b6cd0e5709b8d795a0b0ed06b8675f9841717af92f" gracePeriod=30
Sep 08 11:57:49.102175 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:49.102049    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" containerID="cri-o://0ef5b17891d05583a6e2c199759708b4af0aa081cea9e02c1477b155e491b2cb" gracePeriod=30
Sep 08 11:57:49.864208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:49.864105    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 08 11:57:50.576202 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.576165    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerID="cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d" exitCode=0
Sep 08 11:57:50.576202 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.576192    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerID="b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73" exitCode=0
Sep 08 11:57:50.576677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.576234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerDied","Data":"cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d"}
Sep 08 11:57:50.576677 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.576275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerDied","Data":"b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73"}
Sep 08 11:57:50.579142 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.579117    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerID="0ef5b17891d05583a6e2c199759708b4af0aa081cea9e02c1477b155e491b2cb" exitCode=0
Sep 08 11:57:50.579142 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.579136    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerID="c2d222d1ac309302482804b6cd0e5709b8d795a0b0ed06b8675f9841717af92f" exitCode=0
Sep 08 11:57:50.579302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.579165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"0ef5b17891d05583a6e2c199759708b4af0aa081cea9e02c1477b155e491b2cb"}
Sep 08 11:57:50.579302 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:50.579193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"c2d222d1ac309302482804b6cd0e5709b8d795a0b0ed06b8675f9841717af92f"}
Sep 08 11:57:52.876720 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:52.876672    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 08 11:57:55.662371 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:55.662331    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 08 11:57:57.380406 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:57.380368    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 08 11:57:59.864077 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:57:59.863985    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 08 11:58:02.876109 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:02.876061    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 08 11:58:05.662525 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:05.662481    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 08 11:58:07.380323 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:07.380279    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 08 11:58:09.864101 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:09.864055    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 08 11:58:09.864514 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:09.864197    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:58:12.876438 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:12.876394    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 08 11:58:12.876878 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:12.876521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:58:15.662323 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:15.662287    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 08 11:58:15.662721 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:15.662427    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:58:17.380920 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:17.380879    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 08 11:58:17.381310 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:17.381002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:58:19.178878 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.178792    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 08 11:58:19.179222 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.178792    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 08 11:58:19.565250 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.565225    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:58:19.680959 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.680931    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1322ccc-8890-47f3-8b85-77ba42da1ef6-feast-data\") pod \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") "
Sep 08 11:58:19.681088 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.680981    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f1322ccc-8890-47f3-8b85-77ba42da1ef6-registry-tls\") pod \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") "
Sep 08 11:58:19.681088 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.681016    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r49m9\" (UniqueName: \"kubernetes.io/projected/f1322ccc-8890-47f3-8b85-77ba42da1ef6-kube-api-access-r49m9\") pod \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") "
Sep 08 11:58:19.681088 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.681069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-offline-tls\") pod \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") "
Sep 08 11:58:19.681218 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.681095    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-ui-tls\") pod \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") "
Sep 08 11:58:19.681218 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.681159    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-online-tls\") pod \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\" (UID: \"f1322ccc-8890-47f3-8b85-77ba42da1ef6\") "
Sep 08 11:58:19.681400 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.681370    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1322ccc-8890-47f3-8b85-77ba42da1ef6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f1322ccc-8890-47f3-8b85-77ba42da1ef6" (UID: "f1322ccc-8890-47f3-8b85-77ba42da1ef6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 11:58:19.681493 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.681453    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1322ccc-8890-47f3-8b85-77ba42da1ef6-feast-data" (OuterVolumeSpecName: "feast-data") pod "f1322ccc-8890-47f3-8b85-77ba42da1ef6" (UID: "f1322ccc-8890-47f3-8b85-77ba42da1ef6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:58:19.683927 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.683895    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f1322ccc-8890-47f3-8b85-77ba42da1ef6" (UID: "f1322ccc-8890-47f3-8b85-77ba42da1ef6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.684014 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.683939    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-online-tls" (OuterVolumeSpecName: "online-tls") pod "f1322ccc-8890-47f3-8b85-77ba42da1ef6" (UID: "f1322ccc-8890-47f3-8b85-77ba42da1ef6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.684014 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.683941    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1322ccc-8890-47f3-8b85-77ba42da1ef6-kube-api-access-r49m9" (OuterVolumeSpecName: "kube-api-access-r49m9") pod "f1322ccc-8890-47f3-8b85-77ba42da1ef6" (UID: "f1322ccc-8890-47f3-8b85-77ba42da1ef6"). InnerVolumeSpecName "kube-api-access-r49m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:58:19.684014 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.683970    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f1322ccc-8890-47f3-8b85-77ba42da1ef6" (UID: "f1322ccc-8890-47f3-8b85-77ba42da1ef6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.699059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.699032    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerID="76e8cb9c4f1f71773fddf32e6ce75de72b304baa1e149bc9a07de699e4b639fe" exitCode=137
Sep 08 11:58:19.699059 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.699055    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerID="03a15e52ff647ed3bd705b24fe7ed76a66d1e34736d69a5820218893b5958c2b" exitCode=137
Sep 08 11:58:19.699208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.699100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"76e8cb9c4f1f71773fddf32e6ce75de72b304baa1e149bc9a07de699e4b639fe"}
Sep 08 11:58:19.699208 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.699140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"03a15e52ff647ed3bd705b24fe7ed76a66d1e34736d69a5820218893b5958c2b"}
Sep 08 11:58:19.701723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.701699    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerID="5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6" exitCode=137
Sep 08 11:58:19.701818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.701734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerDied","Data":"5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6"}
Sep 08 11:58:19.701818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.701763    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8" event={"ID":"f1322ccc-8890-47f3-8b85-77ba42da1ef6","Type":"ContainerDied","Data":"170778ba0f84250bf14550107fa7fa904ccbf4f8b963f9de479eef9fd2d4152e"}
Sep 08 11:58:19.701818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.701771    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"
Sep 08 11:58:19.701818 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.701787    2577 scope.go:117] "RemoveContainer" containerID="cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d"
Sep 08 11:58:19.710752 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.710734    2577 scope.go:117] "RemoveContainer" containerID="5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6"
Sep 08 11:58:19.719662 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.719641    2577 scope.go:117] "RemoveContainer" containerID="b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73"
Sep 08 11:58:19.727723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.727639    2577 scope.go:117] "RemoveContainer" containerID="b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99"
Sep 08 11:58:19.728772 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.728748    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"]
Sep 08 11:58:19.733559 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.733538    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-2c9k8"]
Sep 08 11:58:19.753542 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.753519    2577 scope.go:117] "RemoveContainer" containerID="44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b"
Sep 08 11:58:19.761759 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.761739    2577 scope.go:117] "RemoveContainer" containerID="cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d"
Sep 08 11:58:19.762093 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:58:19.762075    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d\": container with ID starting with cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d not found: ID does not exist" containerID="cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d"
Sep 08 11:58:19.762151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762101    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d"} err="failed to get container status \"cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d\": rpc error: code = NotFound desc = could not find container \"cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d\": container with ID starting with cdb34aafc528bbbca203469ffa3b88e92646221efd8c8b4bc2dd11bb8a2dad0d not found: ID does not exist"
Sep 08 11:58:19.762151 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762120    2577 scope.go:117] "RemoveContainer" containerID="5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6"
Sep 08 11:58:19.762376 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:58:19.762359    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6\": container with ID starting with 5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6 not found: ID does not exist" containerID="5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6"
Sep 08 11:58:19.762441 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762385    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6"} err="failed to get container status \"5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6\": rpc error: code = NotFound desc = could not find container \"5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6\": container with ID starting with 5aa2255cabffc834be2e782ead823021e52085d3705f52a4567e75f94ba60bb6 not found: ID does not exist"
Sep 08 11:58:19.762441 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762407    2577 scope.go:117] "RemoveContainer" containerID="b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73"
Sep 08 11:58:19.762704 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:58:19.762681    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73\": container with ID starting with b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73 not found: ID does not exist" containerID="b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73"
Sep 08 11:58:19.762789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762710    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73"} err="failed to get container status \"b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73\": rpc error: code = NotFound desc = could not find container \"b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73\": container with ID starting with b0aa1c4a19abe28d5faae7e4b0485d0f8a4eeb6d5b3cd7d71115383802e55c73 not found: ID does not exist"
Sep 08 11:58:19.762789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762729    2577 scope.go:117] "RemoveContainer" containerID="b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99"
Sep 08 11:58:19.762789 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.762768    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:58:19.763049 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:58:19.763025    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99\": container with ID starting with b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99 not found: ID does not exist" containerID="b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99"
Sep 08 11:58:19.763091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.763057    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99"} err="failed to get container status \"b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99\": rpc error: code = NotFound desc = could not find container \"b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99\": container with ID starting with b4adc745716984e2fee042a3c2333c9269146160a12a2622bfd8c14245d59c99 not found: ID does not exist"
Sep 08 11:58:19.763091 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.763078    2577 scope.go:117] "RemoveContainer" containerID="44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b"
Sep 08 11:58:19.763326 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:58:19.763310    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b\": container with ID starting with 44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b not found: ID does not exist" containerID="44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b"
Sep 08 11:58:19.763387 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.763331    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b"} err="failed to get container status \"44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b\": rpc error: code = NotFound desc = could not find container \"44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b\": container with ID starting with 44cd19816883270646a3513d819e9981c09738cdf22d4f3cbc9ed7d977051f9b not found: ID does not exist"
Sep 08 11:58:19.782237 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.782214    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f1322ccc-8890-47f3-8b85-77ba42da1ef6-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.782237 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.782236    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f1322ccc-8890-47f3-8b85-77ba42da1ef6-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.782384 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.782245    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r49m9\" (UniqueName: \"kubernetes.io/projected/f1322ccc-8890-47f3-8b85-77ba42da1ef6-kube-api-access-r49m9\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.782384 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.782254    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.782384 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.782262    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.782384 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.782270    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f1322ccc-8890-47f3-8b85-77ba42da1ef6-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.883294 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.883261    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-offline-tls\") pod \"6ed129cd-5661-4c16-aa30-f98aaddaa044\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") "
Sep 08 11:58:19.883466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.883306    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mn5c\" (UniqueName: \"kubernetes.io/projected/6ed129cd-5661-4c16-aa30-f98aaddaa044-kube-api-access-5mn5c\") pod \"6ed129cd-5661-4c16-aa30-f98aaddaa044\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") "
Sep 08 11:58:19.883466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.883349    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-registry-tls\") pod \"6ed129cd-5661-4c16-aa30-f98aaddaa044\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") "
Sep 08 11:58:19.883466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.883374    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed129cd-5661-4c16-aa30-f98aaddaa044-feast-data\") pod \"6ed129cd-5661-4c16-aa30-f98aaddaa044\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") "
Sep 08 11:58:19.883466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.883398    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-ui-tls\") pod \"6ed129cd-5661-4c16-aa30-f98aaddaa044\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") "
Sep 08 11:58:19.883466 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.883420    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls\") pod \"6ed129cd-5661-4c16-aa30-f98aaddaa044\" (UID: \"6ed129cd-5661-4c16-aa30-f98aaddaa044\") "
Sep 08 11:58:19.884097 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.884063    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ed129cd-5661-4c16-aa30-f98aaddaa044-feast-data" (OuterVolumeSpecName: "feast-data") pod "6ed129cd-5661-4c16-aa30-f98aaddaa044" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 11:58:19.885669 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.885628    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6ed129cd-5661-4c16-aa30-f98aaddaa044" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.885669 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.885641    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ed129cd-5661-4c16-aa30-f98aaddaa044-kube-api-access-5mn5c" (OuterVolumeSpecName: "kube-api-access-5mn5c") pod "6ed129cd-5661-4c16-aa30-f98aaddaa044" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044"). InnerVolumeSpecName "kube-api-access-5mn5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 11:58:19.885832 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.885646    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6ed129cd-5661-4c16-aa30-f98aaddaa044" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.885940 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.885921    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls" (OuterVolumeSpecName: "online-tls") pod "6ed129cd-5661-4c16-aa30-f98aaddaa044" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.885980 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.885939    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6ed129cd-5661-4c16-aa30-f98aaddaa044" (UID: "6ed129cd-5661-4c16-aa30-f98aaddaa044"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 11:58:19.984527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.984444    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.984527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.984476    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6ed129cd-5661-4c16-aa30-f98aaddaa044-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.984527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.984485    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.984527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.984495    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.984527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.984503    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6ed129cd-5661-4c16-aa30-f98aaddaa044-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:19.984527 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:19.984511    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mn5c\" (UniqueName: \"kubernetes.io/projected/6ed129cd-5661-4c16-aa30-f98aaddaa044-kube-api-access-5mn5c\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 11:58:20.709880 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.709849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq" event={"ID":"6ed129cd-5661-4c16-aa30-f98aaddaa044","Type":"ContainerDied","Data":"96c5bf2ff4813560d551861d2325a8774037317731f40efe533e40cffe9a58d0"}
Sep 08 11:58:20.710354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.709900    2577 scope.go:117] "RemoveContainer" containerID="0ef5b17891d05583a6e2c199759708b4af0aa081cea9e02c1477b155e491b2cb"
Sep 08 11:58:20.710354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.709858    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"
Sep 08 11:58:20.719355 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.719332    2577 scope.go:117] "RemoveContainer" containerID="76e8cb9c4f1f71773fddf32e6ce75de72b304baa1e149bc9a07de699e4b639fe"
Sep 08 11:58:20.726941 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.726919    2577 scope.go:117] "RemoveContainer" containerID="c2d222d1ac309302482804b6cd0e5709b8d795a0b0ed06b8675f9841717af92f"
Sep 08 11:58:20.734848 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.734797    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"]
Sep 08 11:58:20.734907 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.734894    2577 scope.go:117] "RemoveContainer" containerID="03a15e52ff647ed3bd705b24fe7ed76a66d1e34736d69a5820218893b5958c2b"
Sep 08 11:58:20.739508 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.739485    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sg4dq"]
Sep 08 11:58:20.743052 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.743036    2577 scope.go:117] "RemoveContainer" containerID="c51327ebbd340d4112543bd54d40b0f6713c4d63379d84321230347d3c06f92c"
Sep 08 11:58:20.750050 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:20.750032    2577 scope.go:117] "RemoveContainer" containerID="50c321efe8a1cb94ad216299d3f09d1b9019cf37da72f7f344be4dd3cecc3cf9"
Sep 08 11:58:21.481763 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:21.481733    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" path="/var/lib/kubelet/pods/6ed129cd-5661-4c16-aa30-f98aaddaa044/volumes"
Sep 08 11:58:21.482366 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:58:21.482352    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" path="/var/lib/kubelet/pods/f1322ccc-8890-47f3-8b85-77ba42da1ef6/volumes"
Sep 08 11:59:00.840354 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840318    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"]
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840637    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840650    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840661    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="feast-init"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840666    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="feast-init"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840672    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840678    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840684    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="offline"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840689    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="offline"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840698    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840703    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840712    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="feast-init"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840718    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="feast-init"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840724    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="feast-apply"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840729    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="feast-apply"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840737    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840742    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840749    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="feast-apply"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840753    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="feast-apply"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840760    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840765    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840772    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840777    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840845    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="online"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840854    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="ui"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840859    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="ui"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840867    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="offline"
Sep 08 11:59:00.840858 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840872    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1322ccc-8890-47f3-8b85-77ba42da1ef6" containerName="online"
Sep 08 11:59:00.841682 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840879    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="registry"
Sep 08 11:59:00.841682 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.840884    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ed129cd-5661-4c16-aa30-f98aaddaa044" containerName="offline"
Sep 08 11:59:00.844352 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.844334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:00.847438 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.847407    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 08 11:59:00.847613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.847444    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 08 11:59:00.847613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.847540    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 11:59:00.847613 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.847597    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 08 11:59:00.847806 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.847694    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 08 11:59:00.848131 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.848114    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xktfp\""
Sep 08 11:59:00.848288 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.848272    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 11:59:00.860054 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.860017    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"]
Sep 08 11:59:00.913739 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.913701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbh7v\" (UniqueName: \"kubernetes.io/projected/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-kube-api-access-dbh7v\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:00.913923 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.913744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:00.913923 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.913776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:00.913923 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.913816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:00.913923 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.913841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:00.913923 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:00.913864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014256 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbh7v\" (UniqueName: \"kubernetes.io/projected/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-kube-api-access-dbh7v\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014437 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014437 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:59:01.014371    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 11:59:01.014622 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:59:01.014448    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls podName:9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b nodeName:}" failed. No retries permitted until 2026-09-08 11:59:01.514428111 +0000 UTC m=+1494.531220881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-z4b8x" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 11:59:01.014622 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014622 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014622 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.014853 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:59:01.014654    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 11:59:01.014853 ip-10-0-143-186 kubenswrapper[2577]: E0908 11:59:01.014727    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls podName:9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b nodeName:}" failed. No retries permitted until 2026-09-08 11:59:01.514707034 +0000 UTC m=+1494.531499804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-z4b8x" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 11:59:01.015019 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.014995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.016980 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.016951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.017084 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.016981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.023383 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.023360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbh7v\" (UniqueName: \"kubernetes.io/projected/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-kube-api-access-dbh7v\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.518147 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.518105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.518147 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.518153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.520517 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.520489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.520667 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.520638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-z4b8x\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:01.765674 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:01.765637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:02.067173 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:02.067148    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"]
Sep 08 11:59:02.068957 ip-10-0-143-186 kubenswrapper[2577]: W0908 11:59:02.068926    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bc1f72b_7c4a_48ef_afe0_1c1ca2210b7b.slice/crio-04ae8c6069aabcd2aa72f0c785344e636f8f2505863422859546fa6012efb339 WatchSource:0}: Error finding container 04ae8c6069aabcd2aa72f0c785344e636f8f2505863422859546fa6012efb339: Status 404 returned error can't find the container with id 04ae8c6069aabcd2aa72f0c785344e636f8f2505863422859546fa6012efb339
Sep 08 11:59:02.874382 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:02.874347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"85acf828c671e3b37535c5c11eac4a7440ee98b3a5a94fa66152b9090de29e62"}
Sep 08 11:59:02.874589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:02.874396    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"04ae8c6069aabcd2aa72f0c785344e636f8f2505863422859546fa6012efb339"}
Sep 08 11:59:07.464887 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:07.464801    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:59:07.468589 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:07.468551    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 11:59:07.894740 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:07.894704    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerID="85acf828c671e3b37535c5c11eac4a7440ee98b3a5a94fa66152b9090de29e62" exitCode=0
Sep 08 11:59:07.894913 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:07.894780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"85acf828c671e3b37535c5c11eac4a7440ee98b3a5a94fa66152b9090de29e62"}
Sep 08 11:59:08.901620 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:08.901586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"cd20166c3cb7eeba004869de390cc73b83e62228724caf6ace1b9033114eea53"}
Sep 08 11:59:13.922704 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:13.922674    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerID="cd20166c3cb7eeba004869de390cc73b83e62228724caf6ace1b9033114eea53" exitCode=0
Sep 08 11:59:13.923178 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:13.922748    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"cd20166c3cb7eeba004869de390cc73b83e62228724caf6ace1b9033114eea53"}
Sep 08 11:59:14.933179 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:14.933129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"56b0e31e8f443d3d42abd3ae7d7039908862aa90f80e1dfc8cf3ee95b4fe5e73"}
Sep 08 11:59:14.933723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:14.933206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"5b1c0de5a983030bc656fa1f78b61eb40faec371b11964b90274aeca2db174f0"}
Sep 08 11:59:14.933723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:14.933228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"819c9ae54894dfe8859e60251b4758510a90e1cff98426d7e9973285d2edd4da"}
Sep 08 11:59:14.933723 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:14.933247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerStarted","Data":"ae5ab134aedff3dd97f54e834ec8b85cd5daab7b96c6cafbfd06132d6c3d23c5"}
Sep 08 11:59:14.961093 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:14.961026    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podStartSLOduration=14.961003743 podStartE2EDuration="14.961003743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 11:59:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 11:59:14.958321511 +0000 UTC m=+1507.975114313" watchObservedRunningTime="2026-09-08 11:59:14.961003743 +0000 UTC m=+1507.977796533"
Sep 08 11:59:16.766422 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.766379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:16.766953 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.766467    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:16.766953 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.766488    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:16.767424 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.767402    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:16.768419 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.768383    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 08 11:59:16.768518 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.768430    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 08 11:59:16.768518 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.768453    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 08 11:59:16.768728 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:16.768694    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 08 11:59:19.767035 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:19.766977    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.34:6571: connect: connection refused"
Sep 08 11:59:19.767035 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:19.767025    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.34:8816: connect: connection refused"
Sep 08 11:59:19.767584 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:19.766986    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 08 11:59:19.767584 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:19.766982    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 08 11:59:21.766507 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:21.766453    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:21.767239 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:21.767212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:21.767239 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:21.767249    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:21.767458 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:21.767270    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.767329 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.767282    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.767762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.767447    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.767762 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.767731    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.773641 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.773608    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.977591 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.977536    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.977764 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.977716    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.977764 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.977756    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 11:59:22.980408 ip-10-0-143-186 kubenswrapper[2577]: I0908 11:59:22.980385    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 12:00:23.976783 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:23.976750    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"]
Sep 08 12:00:23.979685 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:23.976995    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="registry" containerID="cri-o://ae5ab134aedff3dd97f54e834ec8b85cd5daab7b96c6cafbfd06132d6c3d23c5" gracePeriod=30
Sep 08 12:00:23.979685 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:23.977036    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui" containerID="cri-o://56b0e31e8f443d3d42abd3ae7d7039908862aa90f80e1dfc8cf3ee95b4fe5e73" gracePeriod=30
Sep 08 12:00:23.979685 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:23.977112    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online" containerID="cri-o://819c9ae54894dfe8859e60251b4758510a90e1cff98426d7e9973285d2edd4da" gracePeriod=30
Sep 08 12:00:23.979685 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:23.977160    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="offline" containerID="cri-o://5b1c0de5a983030bc656fa1f78b61eb40faec371b11964b90274aeca2db174f0" gracePeriod=30
Sep 08 12:00:24.401502 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.401459    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"]
Sep 08 12:00:24.405279 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.405254    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.407730 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.407706    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gfk2h\""
Sep 08 12:00:24.423977 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.423944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"]
Sep 08 12:00:24.531970 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.531925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.531970 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.531977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.532252 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.532008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.532252 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.532086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwrjq\" (UniqueName: \"kubernetes.io/projected/7f8b6115-0bfe-4ba9-9776-abfe49937eef-kube-api-access-vwrjq\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.532252 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.532108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8b6115-0bfe-4ba9-9776-abfe49937eef-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.532252 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.532128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633291 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwrjq\" (UniqueName: \"kubernetes.io/projected/7f8b6115-0bfe-4ba9-9776-abfe49937eef-kube-api-access-vwrjq\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633291 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8b6115-0bfe-4ba9-9776-abfe49937eef-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633582 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633582 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633582 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633582 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.633582 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:00:24.633526    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 12:00:24.633886 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:00:24.633614    2577 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 08 12:00:24.633886 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:00:24.633637    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls podName:7f8b6115-0bfe-4ba9-9776-abfe49937eef nodeName:}" failed. No retries permitted until 2026-09-08 12:00:25.133611511 +0000 UTC m=+1578.150404305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-t95f4" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 12:00:24.633886 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:00:24.633712    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls podName:7f8b6115-0bfe-4ba9-9776-abfe49937eef nodeName:}" failed. No retries permitted until 2026-09-08 12:00:25.133685438 +0000 UTC m=+1578.150478203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls") pod "feast-simple-feast-setup-57576b8fcf-t95f4" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef") : secret "feast-simple-feast-setup-online-tls" not found
Sep 08 12:00:24.633886 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.633797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8b6115-0bfe-4ba9-9776-abfe49937eef-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.636040 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.636017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.636144 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.636056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:24.642623 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:24.642590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwrjq\" (UniqueName: \"kubernetes.io/projected/7f8b6115-0bfe-4ba9-9776-abfe49937eef-kube-api-access-vwrjq\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:25.138140 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.138089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:25.138666 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.138154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:25.140690 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.140663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:25.140789 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.140663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-t95f4\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:25.233693 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.233657    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerID="56b0e31e8f443d3d42abd3ae7d7039908862aa90f80e1dfc8cf3ee95b4fe5e73" exitCode=0
Sep 08 12:00:25.233693 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.233682    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerID="819c9ae54894dfe8859e60251b4758510a90e1cff98426d7e9973285d2edd4da" exitCode=0
Sep 08 12:00:25.233891 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.233726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"56b0e31e8f443d3d42abd3ae7d7039908862aa90f80e1dfc8cf3ee95b4fe5e73"}
Sep 08 12:00:25.233891 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.233771    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"819c9ae54894dfe8859e60251b4758510a90e1cff98426d7e9973285d2edd4da"}
Sep 08 12:00:25.316420 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.316382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:25.596788 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:25.596763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"]
Sep 08 12:00:25.598850 ip-10-0-143-186 kubenswrapper[2577]: W0908 12:00:25.598822    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f8b6115_0bfe_4ba9_9776_abfe49937eef.slice/crio-cf1dd50f5cc57ca1c8b9d751fc4ba2e4df1043fcbe017a44f47b918fc6f6ff93 WatchSource:0}: Error finding container cf1dd50f5cc57ca1c8b9d751fc4ba2e4df1043fcbe017a44f47b918fc6f6ff93: Status 404 returned error can't find the container with id cf1dd50f5cc57ca1c8b9d751fc4ba2e4df1043fcbe017a44f47b918fc6f6ff93
Sep 08 12:00:26.239180 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:26.239142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"}
Sep 08 12:00:26.239180 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:26.239186    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"cf1dd50f5cc57ca1c8b9d751fc4ba2e4df1043fcbe017a44f47b918fc6f6ff93"}
Sep 08 12:00:31.260053 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:31.260013    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerID="df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270" exitCode=0
Sep 08 12:00:31.260429 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:31.260076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"}
Sep 08 12:00:32.265420 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:32.265385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"}
Sep 08 12:00:32.977454 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:32.977405    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 08 12:00:32.977454 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:32.977441    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 08 12:00:37.289939 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:37.289904    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerID="d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4" exitCode=0
Sep 08 12:00:37.290332 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:37.289955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"}
Sep 08 12:00:38.299928 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:38.299886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"}
Sep 08 12:00:38.300438 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:38.299954    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"}
Sep 08 12:00:38.300438 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:38.299978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"}
Sep 08 12:00:38.300438 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:38.299998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerStarted","Data":"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"}
Sep 08 12:00:38.339294 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:38.339194    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podStartSLOduration=14.339175229 podStartE2EDuration="14.339175229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 12:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 12:00:38.338259552 +0000 UTC m=+1591.355052341" watchObservedRunningTime="2026-09-08 12:00:38.339175229 +0000 UTC m=+1591.355968018"
Sep 08 12:00:40.317219 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.317184    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:40.317848 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.317824    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:40.317995 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.317857    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:40.317995 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.317875    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:40.319780 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.319629    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Sep 08 12:00:40.319780 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.319659    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 08 12:00:40.319780 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.319674    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Sep 08 12:00:40.319780 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:40.319710    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 08 12:00:42.978111 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:42.978026    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 08 12:00:42.978752 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:42.978604    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 08 12:00:43.317348 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:43.317298    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.35:8816: connect: connection refused"
Sep 08 12:00:43.317348 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:43.317332    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 08 12:00:43.317655 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:43.317298    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.35:6571: connect: connection refused"
Sep 08 12:00:43.317655 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:43.317309    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 08 12:00:45.316880 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:45.316837    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:45.317385 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:45.317264    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:45.317385 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:45.317351    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:45.317496 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:45.317402    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.318168 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.318138    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.318623 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.318445    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.318623 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.318550    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.324012 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.323989    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.346873 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.346787    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.347122 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.346942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.347530 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.347506    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:46.350011 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:46.349988    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:00:52.977859 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:52.977805    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.34:8443: connect: connection refused"
Sep 08 12:00:52.978351 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:52.977803    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.34:6567/health\": dial tcp 10.132.0.34:6567: connect: connection refused"
Sep 08 12:00:52.978351 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:52.977957    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 12:00:52.978351 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:52.978030    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 12:00:54.381019 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.380984    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerID="5b1c0de5a983030bc656fa1f78b61eb40faec371b11964b90274aeca2db174f0" exitCode=137
Sep 08 12:00:54.381019 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.381012    2577 generic.go:356] "Generic (PLEG): container finished" podID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerID="ae5ab134aedff3dd97f54e834ec8b85cd5daab7b96c6cafbfd06132d6c3d23c5" exitCode=137
Sep 08 12:00:54.381440 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.381036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"5b1c0de5a983030bc656fa1f78b61eb40faec371b11964b90274aeca2db174f0"}
Sep 08 12:00:54.381440 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.381074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"ae5ab134aedff3dd97f54e834ec8b85cd5daab7b96c6cafbfd06132d6c3d23c5"}
Sep 08 12:00:54.630678 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.630654    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 12:00:54.677703 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.677618    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls\") pod \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") "
Sep 08 12:00:54.677703 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.677660    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-feast-data\") pod \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") "
Sep 08 12:00:54.677703 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.677688    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls\") pod \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") "
Sep 08 12:00:54.677997 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.677725    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-online-tls\") pod \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") "
Sep 08 12:00:54.677997 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.677754    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbh7v\" (UniqueName: \"kubernetes.io/projected/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-kube-api-access-dbh7v\") pod \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") "
Sep 08 12:00:54.677997 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.677787    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-offline-tls\") pod \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\" (UID: \"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b\") "
Sep 08 12:00:54.678275 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.678226    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-feast-data" (OuterVolumeSpecName: "feast-data") pod "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 12:00:54.680125 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.680084    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-kube-api-access-dbh7v" (OuterVolumeSpecName: "kube-api-access-dbh7v") pod "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b"). InnerVolumeSpecName "kube-api-access-dbh7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 12:00:54.680251 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.680190    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:00:54.680251 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.680218    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-online-tls" (OuterVolumeSpecName: "online-tls") pod "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:00:54.680354 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.680291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:00:54.680354 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.680312    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" (UID: "9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:00:54.779299 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.779261    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:00:54.779299 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.779292    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:00:54.779299 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.779301    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:00:54.779538 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.779332    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:00:54.779538 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.779341    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbh7v\" (UniqueName: \"kubernetes.io/projected/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-kube-api-access-dbh7v\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:00:54.779538 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:54.779352    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:00:55.388374 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.388348    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"
Sep 08 12:00:55.388374 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.388356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x" event={"ID":"9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b","Type":"ContainerDied","Data":"04ae8c6069aabcd2aa72f0c785344e636f8f2505863422859546fa6012efb339"}
Sep 08 12:00:55.388892 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.388404    2577 scope.go:117] "RemoveContainer" containerID="56b0e31e8f443d3d42abd3ae7d7039908862aa90f80e1dfc8cf3ee95b4fe5e73"
Sep 08 12:00:55.397166 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.397147    2577 scope.go:117] "RemoveContainer" containerID="5b1c0de5a983030bc656fa1f78b61eb40faec371b11964b90274aeca2db174f0"
Sep 08 12:00:55.404913 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.404894    2577 scope.go:117] "RemoveContainer" containerID="819c9ae54894dfe8859e60251b4758510a90e1cff98426d7e9973285d2edd4da"
Sep 08 12:00:55.412219 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.412195    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"]
Sep 08 12:00:55.413493 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.413474    2577 scope.go:117] "RemoveContainer" containerID="ae5ab134aedff3dd97f54e834ec8b85cd5daab7b96c6cafbfd06132d6c3d23c5"
Sep 08 12:00:55.416371 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.416349    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-z4b8x"]
Sep 08 12:00:55.421533 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.421515    2577 scope.go:117] "RemoveContainer" containerID="cd20166c3cb7eeba004869de390cc73b83e62228724caf6ace1b9033114eea53"
Sep 08 12:00:55.429081 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.429063    2577 scope.go:117] "RemoveContainer" containerID="85acf828c671e3b37535c5c11eac4a7440ee98b3a5a94fa66152b9090de29e62"
Sep 08 12:00:55.482051 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:00:55.482019    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" path="/var/lib/kubelet/pods/9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b/volumes"
Sep 08 12:01:49.094873 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.094837    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"]
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095148    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="feast-apply"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095160    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="feast-apply"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095168    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="registry"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095173    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="registry"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095184    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095190    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095195    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="offline"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095200    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="offline"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095212    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="feast-init"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095217    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="feast-init"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095225    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095231    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095279    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="ui"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095287    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="offline"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095297    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="online"
Sep 08 12:01:49.095366 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.095304    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc1f72b-7c4a-48ef-afe0-1c1ca2210b7b" containerName="registry"
Sep 08 12:01:49.098530 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.098513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.101056 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101031    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 08 12:01:49.101184 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101036    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 08 12:01:49.101257 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101039    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 08 12:01:49.101257 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101105    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-pkb9s\""
Sep 08 12:01:49.101257 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101111    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 08 12:01:49.101415 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101128    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 08 12:01:49.101855 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.101841    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 08 12:01:49.112696 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.112677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"]
Sep 08 12:01:49.226680 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.226651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.226884 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.226686    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93bb70c0-4f0b-4083-8bdd-c3510a385b78-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.226884 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.226706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93bb70c0-4f0b-4083-8bdd-c3510a385b78-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.226884 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.226744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.226884 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.226787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw44l\" (UniqueName: \"kubernetes.io/projected/93bb70c0-4f0b-4083-8bdd-c3510a385b78-kube-api-access-rw44l\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.226884 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.226874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328107 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw44l\" (UniqueName: \"kubernetes.io/projected/93bb70c0-4f0b-4083-8bdd-c3510a385b78-kube-api-access-rw44l\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328326 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328326 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328326 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93bb70c0-4f0b-4083-8bdd-c3510a385b78-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328326 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93bb70c0-4f0b-4083-8bdd-c3510a385b78-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328326 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.328326 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:01:49.328299    2577 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 08 12:01:49.328662 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:01:49.328391    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls podName:93bb70c0-4f0b-4083-8bdd-c3510a385b78 nodeName:}" failed. No retries permitted until 2026-09-08 12:01:49.828369282 +0000 UTC m=+1662.845162055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 08 12:01:49.328783 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93bb70c0-4f0b-4083-8bdd-c3510a385b78-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.329012 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.328995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93bb70c0-4f0b-4083-8bdd-c3510a385b78-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.330880 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.330855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.330984 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.330901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.341502 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.341473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw44l\" (UniqueName: \"kubernetes.io/projected/93bb70c0-4f0b-4083-8bdd-c3510a385b78-kube-api-access-rw44l\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.832613 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.832554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:49.835023 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:49.834994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gqmtf\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:50.008187 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:50.008149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:01:50.288765 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:50.288738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"]
Sep 08 12:01:50.290341 ip-10-0-143-186 kubenswrapper[2577]: W0908 12:01:50.290313    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93bb70c0_4f0b_4083_8bdd_c3510a385b78.slice/crio-3f3a03e0f1430b46582f1c1149c5ec8cb3795ded54647315eca84ab9f4a26f7a WatchSource:0}: Error finding container 3f3a03e0f1430b46582f1c1149c5ec8cb3795ded54647315eca84ab9f4a26f7a: Status 404 returned error can't find the container with id 3f3a03e0f1430b46582f1c1149c5ec8cb3795ded54647315eca84ab9f4a26f7a
Sep 08 12:01:50.606235 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:50.605405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerStarted","Data":"adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c"}
Sep 08 12:01:50.606235 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:50.605461    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerStarted","Data":"3f3a03e0f1430b46582f1c1149c5ec8cb3795ded54647315eca84ab9f4a26f7a"}
Sep 08 12:01:55.624924 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:55.624891    2577 generic.go:356] "Generic (PLEG): container finished" podID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerID="adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c" exitCode=0
Sep 08 12:01:55.625331 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:55.624978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerDied","Data":"adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c"}
Sep 08 12:01:56.630714 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:01:56.630679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerStarted","Data":"8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa"}
Sep 08 12:02:19.724094 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:19.724053    2577 generic.go:356] "Generic (PLEG): container finished" podID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerID="8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa" exitCode=0
Sep 08 12:02:19.724515 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:19.724125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerDied","Data":"8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa"}
Sep 08 12:02:20.733359 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:20.733318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerStarted","Data":"d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757"}
Sep 08 12:02:20.733802 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:20.733382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerStarted","Data":"e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee"}
Sep 08 12:02:20.733802 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:20.733405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerStarted","Data":"186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6"}
Sep 08 12:02:20.762266 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:20.762208    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podStartSLOduration=31.762191512 podStartE2EDuration="31.762191512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 12:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 12:02:20.75970896 +0000 UTC m=+1693.776501748" watchObservedRunningTime="2026-09-08 12:02:20.762191512 +0000 UTC m=+1693.778984297"
Sep 08 12:02:23.008859 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:23.008818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:23.009470 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:23.009437    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:23.009470 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:23.009469    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:23.010347 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:23.010307    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Sep 08 12:02:23.010347 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:23.010333    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 08 12:02:23.010495 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:23.010350    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 08 12:02:26.009186 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:26.009142    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.36:8816: connect: connection refused"
Sep 08 12:02:26.009755 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:26.009195    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 08 12:02:26.009755 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:26.009214    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 08 12:02:29.009865 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:29.009829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:29.010331 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:29.010015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:29.010402 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:29.010367    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:29.010402 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:29.010399    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:29.010750 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:29.010727    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:29.010968 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:29.010952    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:30.008986 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:30.008899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:30.012696 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:30.012658    2577 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 12:02:32.777293 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:32.777263    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:02:33.539450 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:02:33.539419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:03:31.012742 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:31.012686    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 12:03:35.216773 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.216739    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"]
Sep 08 12:03:35.217290 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.217020    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui" containerID="cri-o://d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757" gracePeriod=30
Sep 08 12:03:35.217290 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.217056    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" containerID="cri-o://186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6" gracePeriod=30
Sep 08 12:03:35.217290 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.217109    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="offline" containerID="cri-o://e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee" gracePeriod=30
Sep 08 12:03:35.439132 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.439097    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"]
Sep 08 12:03:35.439410 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.439376    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="registry" containerID="cri-o://b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6" gracePeriod=30
Sep 08 12:03:35.439578 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.439492    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online" containerID="cri-o://05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3" gracePeriod=30
Sep 08 12:03:35.439578 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.439431    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui" containerID="cri-o://e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e" gracePeriod=30
Sep 08 12:03:35.439726 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:35.439428    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="offline" containerID="cri-o://547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31" gracePeriod=30
Sep 08 12:03:36.053207 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:36.053177    2577 generic.go:356] "Generic (PLEG): container finished" podID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerID="d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757" exitCode=0
Sep 08 12:03:36.053321 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:36.053219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerDied","Data":"d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757"}
Sep 08 12:03:36.346743 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:36.346690    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 08 12:03:36.346743 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:36.346733    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 08 12:03:37.060137 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:37.060106    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerID="e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e" exitCode=0
Sep 08 12:03:37.060137 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:37.060132    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerID="05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3" exitCode=0
Sep 08 12:03:37.060404 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:37.060150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"}
Sep 08 12:03:37.060404 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:37.060202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"}
Sep 08 12:03:37.062933 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:37.062912    2577 generic.go:356] "Generic (PLEG): container finished" podID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerID="186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6" exitCode=0
Sep 08 12:03:37.063048 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:37.062977    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerDied","Data":"186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6"}
Sep 08 12:03:39.010719 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:39.010676    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 08 12:03:42.792513 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:42.792473    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 08 12:03:46.346212 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:46.346165    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 08 12:03:46.346688 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:46.346171    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 08 12:03:49.011101 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:49.011051    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 08 12:03:52.792385 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:52.792346    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 08 12:03:56.346632 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:56.346585    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.35:8443: connect: connection refused"
Sep 08 12:03:56.347090 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:56.346593    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online" probeResult="failure" output="Get \"https://10.132.0.35:6567/health\": dial tcp 10.132.0.35:6567: connect: connection refused"
Sep 08 12:03:56.347090 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:56.346724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:03:56.347090 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:56.346804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:03:59.011219 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:59.011170    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.36:8443: connect: connection refused"
Sep 08 12:03:59.011649 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:03:59.011318    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:04:02.792091 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:02.791995    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online" probeResult="failure" output="Get \"https://10.132.0.36:6567/health\": dial tcp 10.132.0.36:6567: connect: connection refused"
Sep 08 12:04:02.792547 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:02.792157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:04:05.871518 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.871495    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:04:05.997772 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.997696    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93bb70c0-4f0b-4083-8bdd-c3510a385b78-registry-tls\") pod \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") "
Sep 08 12:04:05.997772 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.997768    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-online-tls\") pod \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") "
Sep 08 12:04:05.997986 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.997786    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw44l\" (UniqueName: \"kubernetes.io/projected/93bb70c0-4f0b-4083-8bdd-c3510a385b78-kube-api-access-rw44l\") pod \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") "
Sep 08 12:04:05.997986 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.997816    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls\") pod \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") "
Sep 08 12:04:05.997986 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.997844    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-ui-tls\") pod \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") "
Sep 08 12:04:05.997986 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.997901    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93bb70c0-4f0b-4083-8bdd-c3510a385b78-feast-data\") pod \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\" (UID: \"93bb70c0-4f0b-4083-8bdd-c3510a385b78\") "
Sep 08 12:04:05.998206 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.998173    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93bb70c0-4f0b-4083-8bdd-c3510a385b78-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93bb70c0-4f0b-4083-8bdd-c3510a385b78" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 12:04:05.998524 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:05.998488    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bb70c0-4f0b-4083-8bdd-c3510a385b78-feast-data" (OuterVolumeSpecName: "feast-data") pod "93bb70c0-4f0b-4083-8bdd-c3510a385b78" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 12:04:06.000124 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.000101    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bb70c0-4f0b-4083-8bdd-c3510a385b78-kube-api-access-rw44l" (OuterVolumeSpecName: "kube-api-access-rw44l") pod "93bb70c0-4f0b-4083-8bdd-c3510a385b78" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78"). InnerVolumeSpecName "kube-api-access-rw44l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 12:04:06.000354 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.000332    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-online-tls" (OuterVolumeSpecName: "online-tls") pod "93bb70c0-4f0b-4083-8bdd-c3510a385b78" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.000422 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.000347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "93bb70c0-4f0b-4083-8bdd-c3510a385b78" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.000465 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.000450    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "93bb70c0-4f0b-4083-8bdd-c3510a385b78" (UID: "93bb70c0-4f0b-4083-8bdd-c3510a385b78"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.077662 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.077637    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:04:06.098599 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.098548    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.098599 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.098597    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.098811 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.098609    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93bb70c0-4f0b-4083-8bdd-c3510a385b78-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.098811 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.098620    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93bb70c0-4f0b-4083-8bdd-c3510a385b78-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.098811 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.098655    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93bb70c0-4f0b-4083-8bdd-c3510a385b78-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.098811 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.098669    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw44l\" (UniqueName: \"kubernetes.io/projected/93bb70c0-4f0b-4083-8bdd-c3510a385b78-kube-api-access-rw44l\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.182419 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182383    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerID="547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31" exitCode=137
Sep 08 12:04:06.182419 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182411    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerID="b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6" exitCode=137
Sep 08 12:04:06.182739 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182450    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"
Sep 08 12:04:06.182739 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"}
Sep 08 12:04:06.182739 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"}
Sep 08 12:04:06.182739 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4" event={"ID":"7f8b6115-0bfe-4ba9-9776-abfe49937eef","Type":"ContainerDied","Data":"cf1dd50f5cc57ca1c8b9d751fc4ba2e4df1043fcbe017a44f47b918fc6f6ff93"}
Sep 08 12:04:06.182739 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.182581    2577 scope.go:117] "RemoveContainer" containerID="e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"
Sep 08 12:04:06.185202 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.185179    2577 generic.go:356] "Generic (PLEG): container finished" podID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerID="e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee" exitCode=137
Sep 08 12:04:06.185320 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.185238    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"
Sep 08 12:04:06.185320 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.185258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerDied","Data":"e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee"}
Sep 08 12:04:06.185320 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.185301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf" event={"ID":"93bb70c0-4f0b-4083-8bdd-c3510a385b78","Type":"ContainerDied","Data":"3f3a03e0f1430b46582f1c1149c5ec8cb3795ded54647315eca84ab9f4a26f7a"}
Sep 08 12:04:06.191340 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.191323    2577 scope.go:117] "RemoveContainer" containerID="547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"
Sep 08 12:04:06.199423 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199400    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls\") pod \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") "
Sep 08 12:04:06.199548 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199443    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwrjq\" (UniqueName: \"kubernetes.io/projected/7f8b6115-0bfe-4ba9-9776-abfe49937eef-kube-api-access-vwrjq\") pod \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") "
Sep 08 12:04:06.199548 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199464    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-offline-tls\") pod \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") "
Sep 08 12:04:06.199548 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199487    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8b6115-0bfe-4ba9-9776-abfe49937eef-feast-data\") pod \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") "
Sep 08 12:04:06.199817 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-ui-tls\") pod \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") "
Sep 08 12:04:06.199817 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199606    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls\") pod \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\" (UID: \"7f8b6115-0bfe-4ba9-9776-abfe49937eef\") "
Sep 08 12:04:06.199926 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.199902    2577 scope.go:117] "RemoveContainer" containerID="05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"
Sep 08 12:04:06.200167 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.200106    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8b6115-0bfe-4ba9-9776-abfe49937eef-feast-data" (OuterVolumeSpecName: "feast-data") pod "7f8b6115-0bfe-4ba9-9776-abfe49937eef" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 12:04:06.202023 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.201997    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7f8b6115-0bfe-4ba9-9776-abfe49937eef" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.202123 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.202020    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7f8b6115-0bfe-4ba9-9776-abfe49937eef" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.202123 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.202076    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls" (OuterVolumeSpecName: "online-tls") pod "7f8b6115-0bfe-4ba9-9776-abfe49937eef" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.202329 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.202307    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7f8b6115-0bfe-4ba9-9776-abfe49937eef" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 12:04:06.202410 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.202395    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8b6115-0bfe-4ba9-9776-abfe49937eef-kube-api-access-vwrjq" (OuterVolumeSpecName: "kube-api-access-vwrjq") pod "7f8b6115-0bfe-4ba9-9776-abfe49937eef" (UID: "7f8b6115-0bfe-4ba9-9776-abfe49937eef"). InnerVolumeSpecName "kube-api-access-vwrjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 12:04:06.208589 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.208548    2577 scope.go:117] "RemoveContainer" containerID="b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"
Sep 08 12:04:06.209334 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.209313    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"]
Sep 08 12:04:06.212962 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.212939    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gqmtf"]
Sep 08 12:04:06.216651 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.216634    2577 scope.go:117] "RemoveContainer" containerID="d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"
Sep 08 12:04:06.226271 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.226075    2577 scope.go:117] "RemoveContainer" containerID="df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"
Sep 08 12:04:06.239936 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.239914    2577 scope.go:117] "RemoveContainer" containerID="e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"
Sep 08 12:04:06.240261 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.240234    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e\": container with ID starting with e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e not found: ID does not exist" containerID="e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"
Sep 08 12:04:06.240327 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.240272    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"} err="failed to get container status \"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e\": rpc error: code = NotFound desc = could not find container \"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e\": container with ID starting with e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e not found: ID does not exist"
Sep 08 12:04:06.240327 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.240293    2577 scope.go:117] "RemoveContainer" containerID="547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"
Sep 08 12:04:06.240576 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.240543    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31\": container with ID starting with 547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31 not found: ID does not exist" containerID="547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"
Sep 08 12:04:06.240643 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.240591    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"} err="failed to get container status \"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31\": rpc error: code = NotFound desc = could not find container \"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31\": container with ID starting with 547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31 not found: ID does not exist"
Sep 08 12:04:06.240643 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.240609    2577 scope.go:117] "RemoveContainer" containerID="05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"
Sep 08 12:04:06.240835 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.240819    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3\": container with ID starting with 05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3 not found: ID does not exist" containerID="05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"
Sep 08 12:04:06.240872 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.240840    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"} err="failed to get container status \"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3\": rpc error: code = NotFound desc = could not find container \"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3\": container with ID starting with 05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3 not found: ID does not exist"
Sep 08 12:04:06.240872 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.240852    2577 scope.go:117] "RemoveContainer" containerID="b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"
Sep 08 12:04:06.241081 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.241063    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6\": container with ID starting with b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6 not found: ID does not exist" containerID="b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"
Sep 08 12:04:06.241122 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241086    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"} err="failed to get container status \"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6\": rpc error: code = NotFound desc = could not find container \"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6\": container with ID starting with b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6 not found: ID does not exist"
Sep 08 12:04:06.241122 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241103    2577 scope.go:117] "RemoveContainer" containerID="d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"
Sep 08 12:04:06.241368 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.241352    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4\": container with ID starting with d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4 not found: ID does not exist" containerID="d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"
Sep 08 12:04:06.241425 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241371    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"} err="failed to get container status \"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4\": rpc error: code = NotFound desc = could not find container \"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4\": container with ID starting with d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4 not found: ID does not exist"
Sep 08 12:04:06.241425 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241391    2577 scope.go:117] "RemoveContainer" containerID="df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"
Sep 08 12:04:06.241637 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.241622    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270\": container with ID starting with df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270 not found: ID does not exist" containerID="df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"
Sep 08 12:04:06.241686 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241642    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"} err="failed to get container status \"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270\": rpc error: code = NotFound desc = could not find container \"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270\": container with ID starting with df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270 not found: ID does not exist"
Sep 08 12:04:06.241686 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241662    2577 scope.go:117] "RemoveContainer" containerID="e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"
Sep 08 12:04:06.241858 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241840    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e"} err="failed to get container status \"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e\": rpc error: code = NotFound desc = could not find container \"e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e\": container with ID starting with e1f1abf564763bc350da001efe7fe8bec56eae86c5681b79ed5622c4ddd91b3e not found: ID does not exist"
Sep 08 12:04:06.241903 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.241859    2577 scope.go:117] "RemoveContainer" containerID="547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"
Sep 08 12:04:06.242086 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242061    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31"} err="failed to get container status \"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31\": rpc error: code = NotFound desc = could not find container \"547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31\": container with ID starting with 547019c66c9f61ef9f4ecd891a55210f27ca0e1d0a2ee35b3f21443888aeea31 not found: ID does not exist"
Sep 08 12:04:06.242166 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242088    2577 scope.go:117] "RemoveContainer" containerID="05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"
Sep 08 12:04:06.242326 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242305    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3"} err="failed to get container status \"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3\": rpc error: code = NotFound desc = could not find container \"05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3\": container with ID starting with 05140c0537cc7d382dd85ee1a18ec7f99c12844783a020b9c99f98cd719d4bc3 not found: ID does not exist"
Sep 08 12:04:06.242381 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242327    2577 scope.go:117] "RemoveContainer" containerID="b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"
Sep 08 12:04:06.242534 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242516    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6"} err="failed to get container status \"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6\": rpc error: code = NotFound desc = could not find container \"b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6\": container with ID starting with b3bfd19e951043bb525ac08cd08801fe680a2034fde664e2910e99cb123682d6 not found: ID does not exist"
Sep 08 12:04:06.242650 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242536    2577 scope.go:117] "RemoveContainer" containerID="d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"
Sep 08 12:04:06.242832 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242814    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4"} err="failed to get container status \"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4\": rpc error: code = NotFound desc = could not find container \"d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4\": container with ID starting with d22e39d709c2d386366c6f95558fb32b9eed5bcb1830a91e01c77aeacb140bf4 not found: ID does not exist"
Sep 08 12:04:06.242876 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.242833    2577 scope.go:117] "RemoveContainer" containerID="df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"
Sep 08 12:04:06.243078 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.243059    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270"} err="failed to get container status \"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270\": rpc error: code = NotFound desc = could not find container \"df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270\": container with ID starting with df43144de30301276c082c6f1cbe290bf0af3913838a5aef345c6e28c6a8b270 not found: ID does not exist"
Sep 08 12:04:06.243148 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.243079    2577 scope.go:117] "RemoveContainer" containerID="d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757"
Sep 08 12:04:06.250479 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.250458    2577 scope.go:117] "RemoveContainer" containerID="e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee"
Sep 08 12:04:06.258329 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.258310    2577 scope.go:117] "RemoveContainer" containerID="186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6"
Sep 08 12:04:06.265868 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.265850    2577 scope.go:117] "RemoveContainer" containerID="8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa"
Sep 08 12:04:06.272972 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.272949    2577 scope.go:117] "RemoveContainer" containerID="adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c"
Sep 08 12:04:06.280065 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280047    2577 scope.go:117] "RemoveContainer" containerID="d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757"
Sep 08 12:04:06.280385 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.280364    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757\": container with ID starting with d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757 not found: ID does not exist" containerID="d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757"
Sep 08 12:04:06.280471 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280398    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757"} err="failed to get container status \"d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757\": rpc error: code = NotFound desc = could not find container \"d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757\": container with ID starting with d87ece901c4cb3f98e06f28bde1b869978a0164ee3e613859c50e8ee58a4d757 not found: ID does not exist"
Sep 08 12:04:06.280471 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280423    2577 scope.go:117] "RemoveContainer" containerID="e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee"
Sep 08 12:04:06.280721 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.280704    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee\": container with ID starting with e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee not found: ID does not exist" containerID="e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee"
Sep 08 12:04:06.280773 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280726    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee"} err="failed to get container status \"e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee\": rpc error: code = NotFound desc = could not find container \"e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee\": container with ID starting with e0693f01d73598d36d465ae4e6dd88926d5eed66a21133940f5968bc123e96ee not found: ID does not exist"
Sep 08 12:04:06.280773 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280742    2577 scope.go:117] "RemoveContainer" containerID="186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6"
Sep 08 12:04:06.280973 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.280956    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6\": container with ID starting with 186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6 not found: ID does not exist" containerID="186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6"
Sep 08 12:04:06.281017 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280981    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6"} err="failed to get container status \"186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6\": rpc error: code = NotFound desc = could not find container \"186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6\": container with ID starting with 186e767321d790cf5f66c607bb230ecc4935cdc69ed3f4401c1fda35d108d1e6 not found: ID does not exist"
Sep 08 12:04:06.281017 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.280999    2577 scope.go:117] "RemoveContainer" containerID="8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa"
Sep 08 12:04:06.281230 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.281212    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa\": container with ID starting with 8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa not found: ID does not exist" containerID="8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa"
Sep 08 12:04:06.281292 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.281239    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa"} err="failed to get container status \"8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa\": rpc error: code = NotFound desc = could not find container \"8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa\": container with ID starting with 8927801fc8d7b1bec8191217909f0daa1f87b06e900449caeed22f76f3068caa not found: ID does not exist"
Sep 08 12:04:06.281292 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.281260    2577 scope.go:117] "RemoveContainer" containerID="adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c"
Sep 08 12:04:06.281472 ip-10-0-143-186 kubenswrapper[2577]: E0908 12:04:06.281458    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c\": container with ID starting with adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c not found: ID does not exist" containerID="adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c"
Sep 08 12:04:06.281508 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.281476    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c"} err="failed to get container status \"adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c\": rpc error: code = NotFound desc = could not find container \"adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c\": container with ID starting with adaacff7c9e93031d660bfb2d64251596340e514bf193487a1d12a6f624f2a9c not found: ID does not exist"
Sep 08 12:04:06.300455 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.300433    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-registry-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.300541 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.300460    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwrjq\" (UniqueName: \"kubernetes.io/projected/7f8b6115-0bfe-4ba9-9776-abfe49937eef-kube-api-access-vwrjq\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.300541 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.300470    2577 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-offline-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.300541 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.300478    2577 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8b6115-0bfe-4ba9-9776-abfe49937eef-feast-data\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.300541 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.300486    2577 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-ui-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.300541 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.300493    2577 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8b6115-0bfe-4ba9-9776-abfe49937eef-online-tls\") on node \"ip-10-0-143-186.ec2.internal\" DevicePath \"\""
Sep 08 12:04:06.505663 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.505584    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"]
Sep 08 12:04:06.509339 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:06.509300    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-t95f4"]
Sep 08 12:04:07.482669 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:07.482630    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" path="/var/lib/kubelet/pods/7f8b6115-0bfe-4ba9-9776-abfe49937eef/volumes"
Sep 08 12:04:07.483421 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:07.483401    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" path="/var/lib/kubelet/pods/93bb70c0-4f0b-4083-8bdd-c3510a385b78/volumes"
Sep 08 12:04:07.488684 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:07.488661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 12:04:07.493012 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:07.492991    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 12:04:43.914976 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.914944    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ns6s9/must-gather-446tp"]
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915221    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="registry"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915231    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="registry"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915242    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="feast-init"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915248    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="feast-init"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915255    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915261    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915272    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="feast-init"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915277    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="feast-init"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915283    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915288    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915294    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="offline"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915299    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="offline"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915305    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915310    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915317    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915322    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915328    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="feast-apply"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915333    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="feast-apply"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915341    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="offline"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915346    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="offline"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915352    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="feast-apply"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915356    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="feast-apply"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915396    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="offline"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915402    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="ui"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915407    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="online"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915416    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="registry"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915421    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bb70c0-4f0b-4083-8bdd-c3510a385b78" containerName="ui"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915427    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="online"
Sep 08 12:04:43.915456 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.915432    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8b6115-0bfe-4ba9-9776-abfe49937eef" containerName="offline"
Sep 08 12:04:43.918274 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.918257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:43.922063 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.922034    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ns6s9\"/\"openshift-service-ca.crt\""
Sep 08 12:04:43.922210 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.922188    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ns6s9\"/\"kube-root-ca.crt\""
Sep 08 12:04:43.922892 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.922870    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ns6s9\"/\"default-dockercfg-nzqjx\""
Sep 08 12:04:43.933677 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.933651    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ns6s9/must-gather-446tp"]
Sep 08 12:04:43.983849 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.983801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mds5\" (UniqueName: \"kubernetes.io/projected/9b71235d-22a5-4378-a9b2-4784cd13405a-kube-api-access-2mds5\") pod \"must-gather-446tp\" (UID: \"9b71235d-22a5-4378-a9b2-4784cd13405a\") " pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:43.984024 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:43.983877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9b71235d-22a5-4378-a9b2-4784cd13405a-must-gather-output\") pod \"must-gather-446tp\" (UID: \"9b71235d-22a5-4378-a9b2-4784cd13405a\") " pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:44.084653 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.084611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mds5\" (UniqueName: \"kubernetes.io/projected/9b71235d-22a5-4378-a9b2-4784cd13405a-kube-api-access-2mds5\") pod \"must-gather-446tp\" (UID: \"9b71235d-22a5-4378-a9b2-4784cd13405a\") " pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:44.084823 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.084673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9b71235d-22a5-4378-a9b2-4784cd13405a-must-gather-output\") pod \"must-gather-446tp\" (UID: \"9b71235d-22a5-4378-a9b2-4784cd13405a\") " pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:44.084962 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.084942    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9b71235d-22a5-4378-a9b2-4784cd13405a-must-gather-output\") pod \"must-gather-446tp\" (UID: \"9b71235d-22a5-4378-a9b2-4784cd13405a\") " pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:44.093770 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.093739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mds5\" (UniqueName: \"kubernetes.io/projected/9b71235d-22a5-4378-a9b2-4784cd13405a-kube-api-access-2mds5\") pod \"must-gather-446tp\" (UID: \"9b71235d-22a5-4378-a9b2-4784cd13405a\") " pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:44.239542 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.239446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ns6s9/must-gather-446tp"
Sep 08 12:04:44.509231 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.509107    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ns6s9/must-gather-446tp"]
Sep 08 12:04:44.512274 ip-10-0-143-186 kubenswrapper[2577]: W0908 12:04:44.512243    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b71235d_22a5_4378_a9b2_4784cd13405a.slice/crio-87248826d4829b29b50f414435313d6f242c712ab293e35154c000b56b2d9586 WatchSource:0}: Error finding container 87248826d4829b29b50f414435313d6f242c712ab293e35154c000b56b2d9586: Status 404 returned error can't find the container with id 87248826d4829b29b50f414435313d6f242c712ab293e35154c000b56b2d9586
Sep 08 12:04:44.514161 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:44.514141    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 12:04:45.340587 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:45.340543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6s9/must-gather-446tp" event={"ID":"9b71235d-22a5-4378-a9b2-4784cd13405a","Type":"ContainerStarted","Data":"87248826d4829b29b50f414435313d6f242c712ab293e35154c000b56b2d9586"}
Sep 08 12:04:46.346728 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:46.346694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6s9/must-gather-446tp" event={"ID":"9b71235d-22a5-4378-a9b2-4784cd13405a","Type":"ContainerStarted","Data":"cafcfa57c9c872312d5ba8597c915911cf28e6e0cf7e310c7986a92b72ee8a4b"}
Sep 08 12:04:46.347122 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:46.346737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6s9/must-gather-446tp" event={"ID":"9b71235d-22a5-4378-a9b2-4784cd13405a","Type":"ContainerStarted","Data":"285ba00898dbd25c5a2af4f9f1c093fe921eff20c483b844adae5265df5b7b47"}
Sep 08 12:04:46.672427 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:46.672343    2577 ???:1] "http2: server: error reading preface from client 10.0.143.186:41660: read tcp 10.0.143.186:10250->10.0.143.186:41660: read: connection reset by peer"
Sep 08 12:04:46.680604 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:46.680555    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5n8p5_40d06b34-232c-402a-95c0-ad2fdfd04e31/global-pull-secret-syncer/0.log"
Sep 08 12:04:46.817184 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:46.817154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qzjh2_edba5f2c-1eab-4ae4-9dff-6db20fb63f67/konnectivity-agent/0.log"
Sep 08 12:04:46.934251 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:46.934173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-186.ec2.internal_b7b8a435b6fb2d96183f4d8145fede99/haproxy/0.log"
Sep 08 12:04:50.832199 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:50.832037    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-bmtf5_e24c4281-0d3d-4c5b-9092-8d362c5c40f2/cluster-monitoring-operator/0.log"
Sep 08 12:04:51.011527 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.011434    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-x2vhl_664bef1b-4d50-4c24-bee8-667e1e5cb41a/monitoring-plugin/0.log"
Sep 08 12:04:51.230553 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.230516    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t57zj_0696a996-79d5-4d1e-aebb-b4ffb37fde6e/node-exporter/0.log"
Sep 08 12:04:51.259374 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.259341    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t57zj_0696a996-79d5-4d1e-aebb-b4ffb37fde6e/kube-rbac-proxy/0.log"
Sep 08 12:04:51.285342 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.285314    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t57zj_0696a996-79d5-4d1e-aebb-b4ffb37fde6e/init-textfile/0.log"
Sep 08 12:04:51.320724 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.320655    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fbnsf_7426cb43-e48f-4ce9-92b4-e2e5361244a9/kube-rbac-proxy-main/0.log"
Sep 08 12:04:51.350508 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.350476    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fbnsf_7426cb43-e48f-4ce9-92b4-e2e5361244a9/kube-rbac-proxy-self/0.log"
Sep 08 12:04:51.374919 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.374891    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-fbnsf_7426cb43-e48f-4ce9-92b4-e2e5361244a9/openshift-state-metrics/0.log"
Sep 08 12:04:51.411411 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.411382    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/prometheus/0.log"
Sep 08 12:04:51.441227 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.441197    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/config-reloader/0.log"
Sep 08 12:04:51.467205 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.467173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/thanos-sidecar/0.log"
Sep 08 12:04:51.498051 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.498024    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/kube-rbac-proxy-web/0.log"
Sep 08 12:04:51.526962 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.526935    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/kube-rbac-proxy/0.log"
Sep 08 12:04:51.552156 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.552074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/kube-rbac-proxy-thanos/0.log"
Sep 08 12:04:51.583924 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.583894    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_01dd4c31-0a95-4e66-86f2-e237e99dcda9/init-config-reloader/0.log"
Sep 08 12:04:51.619743 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.619710    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-cpfgb_b7af6a57-2753-47b6-9d75-fdb7e195db98/prometheus-operator/0.log"
Sep 08 12:04:51.642477 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.642441    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-cpfgb_b7af6a57-2753-47b6-9d75-fdb7e195db98/kube-rbac-proxy/0.log"
Sep 08 12:04:51.671363 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.671331    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-glt92_2267dfb0-814d-4e6b-827e-1c446d36f823/prometheus-operator-admission-webhook/0.log"
Sep 08 12:04:51.704973 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.704930    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f586b4db-pzc9f_7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2/telemeter-client/0.log"
Sep 08 12:04:51.735676 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.735642    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f586b4db-pzc9f_7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2/reload/0.log"
Sep 08 12:04:51.759617 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:51.759557    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f586b4db-pzc9f_7a1d7bc5-fc4e-4f13-a314-bc8a2b87a2a2/kube-rbac-proxy/0.log"
Sep 08 12:04:53.900475 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.900396    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ns6s9/must-gather-446tp" podStartSLOduration=10.127062272 podStartE2EDuration="10.900370676s" totalImagesPullingTime="773.308404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 12:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 12:04:46.367486413 +0000 UTC m=+1839.384279202" watchObservedRunningTime="2026-09-08 12:04:53.900370676 +0000 UTC m=+1846.917163464"
Sep 08 12:04:53.901803 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.901774    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"]
Sep 08 12:04:53.907222 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.907196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:53.920078 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.920052    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"]
Sep 08 12:04:53.976313 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.976265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-podres\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:53.976503 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.976342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-lib-modules\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:53.976503 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.976379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrztr\" (UniqueName: \"kubernetes.io/projected/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-kube-api-access-rrztr\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:53.976503 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.976406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-sys\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:53.976503 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:53.976454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-proc\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.077586 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.077526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-podres\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.077890 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.077850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-lib-modules\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078070 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrztr\" (UniqueName: \"kubernetes.io/projected/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-kube-api-access-rrztr\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078202 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-podres\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078202 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078187    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-sys\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078346 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-lib-modules\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078346 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-sys\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078433 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-proc\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.078478 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.078446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-proc\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.087765 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.087741    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrztr\" (UniqueName: \"kubernetes.io/projected/ed5f2d49-2c47-4f64-80dd-9b34ac3d0165-kube-api-access-rrztr\") pod \"perf-node-gather-daemonset-cmkwc\" (UID: \"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165\") " pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.137835 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.137799    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-gfhvq_c46ba7e0-6b21-430a-86ac-2c5bf6b33a57/download-server/0.log"
Sep 08 12:04:54.220873 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.220780    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:54.505870 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:54.505655    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"]
Sep 08 12:04:54.508878 ip-10-0-143-186 kubenswrapper[2577]: W0908 12:04:54.508837    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poded5f2d49_2c47_4f64_80dd_9b34ac3d0165.slice/crio-ea52c01378ab05eb8f7609db528affc682d82d542b9759a2fe3ec0e8b5e23eaa WatchSource:0}: Error finding container ea52c01378ab05eb8f7609db528affc682d82d542b9759a2fe3ec0e8b5e23eaa: Status 404 returned error can't find the container with id ea52c01378ab05eb8f7609db528affc682d82d542b9759a2fe3ec0e8b5e23eaa
Sep 08 12:04:55.395928 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.395891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc" event={"ID":"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165","Type":"ContainerStarted","Data":"dcad155956369965c017774d9a6056ec8a34b3849cdb9cd45dcaca9fde722ff2"}
Sep 08 12:04:55.396322 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.395945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc" event={"ID":"ed5f2d49-2c47-4f64-80dd-9b34ac3d0165","Type":"ContainerStarted","Data":"ea52c01378ab05eb8f7609db528affc682d82d542b9759a2fe3ec0e8b5e23eaa"}
Sep 08 12:04:55.396322 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.395997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:04:55.414987 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.414928    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc" podStartSLOduration=2.414908895 podStartE2EDuration="2.414908895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 12:04:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 12:04:55.414506451 +0000 UTC m=+1848.431299240" watchObservedRunningTime="2026-09-08 12:04:55.414908895 +0000 UTC m=+1848.431701684"
Sep 08 12:04:55.451044 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.451016    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4kdd9_fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0/dns/0.log"
Sep 08 12:04:55.475519 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.475493    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4kdd9_fa4bb79c-3eff-4b6f-a4ef-30d0165ceae0/kube-rbac-proxy/0.log"
Sep 08 12:04:55.605632 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:55.605602    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s7bdl_0508f594-1ab3-46a7-9f2a-74b0cae0b4cc/dns-node-resolver/0.log"
Sep 08 12:04:56.073057 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:56.073022    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fntz6_ef82f585-2bd9-43c8-9b25-fea2e2b6fcbb/node-ca/0.log"
Sep 08 12:04:57.183757 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:57.183719    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zg574_40925518-6cf8-4a53-8691-1f2ba1620173/serve-healthcheck-canary/0.log"
Sep 08 12:04:57.676362 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:57.676331    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g24xd_e14eb257-e257-40db-a184-93b676a9f494/kube-rbac-proxy/0.log"
Sep 08 12:04:57.701863 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:57.701838    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g24xd_e14eb257-e257-40db-a184-93b676a9f494/exporter/0.log"
Sep 08 12:04:57.728283 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:04:57.728254    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g24xd_e14eb257-e257-40db-a184-93b676a9f494/extractor/0.log"
Sep 08 12:05:01.413714 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:01.413684    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ns6s9/perf-node-gather-daemonset-cmkwc"
Sep 08 12:05:03.753805 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.753731    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/kube-multus-additional-cni-plugins/0.log"
Sep 08 12:05:03.778944 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.778914    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/egress-router-binary-copy/0.log"
Sep 08 12:05:03.826423 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.826396    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/cni-plugins/0.log"
Sep 08 12:05:03.855284 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.855255    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/bond-cni-plugin/0.log"
Sep 08 12:05:03.883709 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.883676    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/routeoverride-cni/0.log"
Sep 08 12:05:03.913338 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.913308    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/whereabouts-cni-bincopy/0.log"
Sep 08 12:05:03.946911 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:03.942867    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8t7xn_23f5d473-3c46-4df6-8fe4-603d2bab0ac1/whereabouts-cni/0.log"
Sep 08 12:05:04.570336 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:04.570301    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ht26j_b3ebb6d8-fcd0-4374-a839-71fa6a4cef3d/kube-multus/0.log"
Sep 08 12:05:04.718710 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:04.718661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rgtgk_07065e1e-cfb7-40f3-894d-c793ff6082c9/network-metrics-daemon/0.log"
Sep 08 12:05:04.742091 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:04.742046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rgtgk_07065e1e-cfb7-40f3-894d-c793ff6082c9/kube-rbac-proxy/0.log"
Sep 08 12:05:05.984832 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:05.984788    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-controller/0.log"
Sep 08 12:05:06.005511 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.005479    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/1.log"
Sep 08 12:05:06.005511 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.005510    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovn-acl-logging/0.log"
Sep 08 12:05:06.034997 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.034964    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/kube-rbac-proxy-node/0.log"
Sep 08 12:05:06.073153 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.073118    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 12:05:06.105295 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.105265    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/northd/0.log"
Sep 08 12:05:06.130182 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.130151    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/nbdb/0.log"
Sep 08 12:05:06.153664 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.153435    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/sbdb/0.log"
Sep 08 12:05:06.218232 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:06.218182    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wv5lq_755b8c6c-d324-4a9b-a9ab-f48040b37e83/ovnkube-controller/0.log"
Sep 08 12:05:07.187898 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:07.187866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-ft2gk_44a5c71d-edec-4bdd-a3d8-9579b4c797f0/check-endpoints/0.log"
Sep 08 12:05:07.230049 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:07.230024    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fxbt8_aa1a0924-1237-4815-bef5-1163a4e27167/network-check-target-container/0.log"
Sep 08 12:05:08.246138 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:08.246110    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-fqmrk_a98b045e-4843-4f46-a15e-841d04ff6faa/iptables-alerter/0.log"
Sep 08 12:05:08.925510 ip-10-0-143-186 kubenswrapper[2577]: I0908 12:05:08.925480    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fg72r_27aadf16-bffa-4b4a-8590-d81e9e907798/tuned/0.log"