Sep 17 11:49:23.138306 ip-10-0-142-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 11:49:23.138447 ip-10-0-142-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 11:49:23.138619 ip-10-0-142-23 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 11:49:23.138956 ip-10-0-142-23 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 11:49:33.305150 ip-10-0-142-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 11:49:33.305173 ip-10-0-142-23 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ed3aebfd102f4756a2d1a29b10b3f275 --
Sep 17 11:51:24.041342 ip-10-0-142-23 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 11:51:24.465448 ip-10-0-142-23 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 11:51:24.465448 ip-10-0-142-23 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 11:51:24.465448 ip-10-0-142-23 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 11:51:24.465448 ip-10-0-142-23 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 11:51:24.465448 ip-10-0-142-23 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 11:51:24.467550 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.467478    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 11:51:24.471494 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471480    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 11:51:24.471494 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471494    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471497    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471501    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471504    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471507    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471510    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471512    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471515    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471517    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471520    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471523    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471526    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471528    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471531    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471534    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471536    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471539    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471542    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471544    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471547    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 11:51:24.471563 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471550    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471552    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471554    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471557    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471560    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471562    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471565    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471568    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471571    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471573    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471576    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471579    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471582    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471585    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471587    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471591    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471593    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471596    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471598    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471601    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 11:51:24.472110 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471605    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471608    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471613    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471616    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471619    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471622    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471624    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471627    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471629    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471632    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471635    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471637    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471640    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471642    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471647    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471650    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471652    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471655    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471658    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 11:51:24.472633 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471661    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471663    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471666    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471668    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471671    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471674    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471676    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471679    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471681    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471684    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471687    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471689    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471692    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471695    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471697    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471700    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471702    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471705    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471707    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471710    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 11:51:24.473178 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471712    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471715    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471717    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471719    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471722    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471724    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471728    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471731    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471734    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471737    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471739    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471743    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471747    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471750    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471753    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471755    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471758    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471761    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.471763    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 11:51:24.473685 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472473    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472480    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472483    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472493    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472496    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472499    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472501    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472504    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472507    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472510    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472512    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472515    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472517    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472520    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472523    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472526    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472528    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472531    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472534    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472536    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 11:51:24.474200 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472540    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472545    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472548    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472550    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472553    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472556    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472558    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472561    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472563    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472565    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472568    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472570    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472573    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472575    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472578    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472581    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472589    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472591    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472594    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472596    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 11:51:24.474738 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472599    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472602    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472604    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472607    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472609    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472612    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472615    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472618    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472621    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472624    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472626    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472629    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472631    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472634    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472637    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472639    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472642    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472644    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472647    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472649    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 11:51:24.475291 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472652    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472654    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472657    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472659    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472662    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472664    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472667    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472669    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472671    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472674    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472677    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472679    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472683    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472685    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472688    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472691    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472693    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472696    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472698    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 11:51:24.475822 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472705    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472708    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472712    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472715    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472718    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472721    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472724    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472726    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472730    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472733    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472736    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472739    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472741    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472744    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472746    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472749    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472751    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472754    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472756    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 11:51:24.476328 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.472759    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473817    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473824    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473827    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473830    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473833    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473836    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473839    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473841    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473844    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473846    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473848    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473851    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473856    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473858    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473862    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473864    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473867    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473869    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473872    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 11:51:24.476819 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473874    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473877    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473880    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473882    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473885    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473887    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473889    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473892    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473895    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473897    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473899    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473902    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473904    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473907    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473909    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473912    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473914    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473917    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473919    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 11:51:24.477359 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473922    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473924    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473926    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473929    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473931    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473933    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473937    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473941    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473945    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473948    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473951    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473954    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473957    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473960    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473963    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473965    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473968    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473970    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473973    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473975    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 11:51:24.477879 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473977    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473980    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473982    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473985    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473987    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473989    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473992    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473994    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473997    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.473999    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474002    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474004    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474006    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474009    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474011    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474014    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474016    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474018    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474041    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474045    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 11:51:24.478420 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474051    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474055    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474058    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474061    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474063    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474066    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474068    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474072    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474077    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474080    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474083    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474086    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474089    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474091    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474094    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474096    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474099    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474101    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474104    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474106    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 11:51:24.478943 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474109    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474170    2571 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474205    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474216    2571 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474222    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474227    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474230    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474234    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474238    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474241    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474245    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474248    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474251    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474254    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474257    2571 flags.go:64] FLAG: --cgroup-root=""
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474260    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474263    2571 flags.go:64] FLAG: --client-ca-file=""
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474265    2571 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474268    2571 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474272    2571 flags.go:64] FLAG: --cluster-domain=""
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474274    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474277    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474280    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474283    2571 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 11:51:24.479508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474287    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474290    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474293    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474296    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474299    2571 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474301    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474304    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474307    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474310    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474313    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474316    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474319    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474322    2571 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474326    2571 flags.go:64] FLAG: --enable-server="true"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474329    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474333    2571 flags.go:64] FLAG: --event-burst="100"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474336    2571 flags.go:64] FLAG: --event-qps="50"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474338    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474341    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474344    2571 flags.go:64] FLAG: --eviction-hard=""
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474349    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474352    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474355    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474358    2571 flags.go:64] FLAG: --eviction-soft=""
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474361    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 11:51:24.480130 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474364    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474367    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474369    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474372    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474375    2571 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474378    2571 flags.go:64] FLAG: --feature-gates=""
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474381    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474384    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474387    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474390    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474393    2571 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474396    2571 flags.go:64] FLAG: --help="false"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474398    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474401    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474404    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474407    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474410    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474413    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474416    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474419    2571 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474422    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474425    2571 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474428    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474431    2571 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 11:51:24.480892 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474434    2571 flags.go:64] FLAG: --kube-reserved=""
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474436    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474439    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474445    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474448    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474450    2571 flags.go:64] FLAG: --lock-file=""
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474453    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474456    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474459    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474464    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474467    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474469    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474472    2571 flags.go:64] FLAG: --logging-format="text"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474475    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474478    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474481    2571 flags.go:64] FLAG: --manifest-url=""
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474484    2571 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474488    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474491    2571 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474495    2571 flags.go:64] FLAG: --max-pods="110"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474497    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474500    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474503    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474506    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474508    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 11:51:24.481605 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474511    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474514    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474521    2571 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474524    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474527    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474530    2571 flags.go:64] FLAG: --pod-cidr=""
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474533    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474538    2571 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474541    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474544    2571 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474547    2571 flags.go:64] FLAG: --port="10250"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474551    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474554    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c89f0b9ef965e6ee"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474557    2571 flags.go:64] FLAG: --qos-reserved=""
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474560    2571 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474562    2571 flags.go:64] FLAG: --register-node="true"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474565    2571 flags.go:64] FLAG: --register-with-taints=""
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474569    2571 flags.go:64] FLAG: --registry-burst="10"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474571    2571 flags.go:64] FLAG: --registry-qps="5"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474574    2571 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474577    2571 flags.go:64] FLAG: --reserved-memory=""
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474580    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474583    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474586    2571 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474589    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 11:51:24.482462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474591    2571 flags.go:64] FLAG: --runonce="false"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474594    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474597    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474600    2571 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474603    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474605    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474608    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474611    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474614    2571 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474617    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474621    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474624    2571 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474628    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474631    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474634    2571 flags.go:64] FLAG: --system-cgroups=""
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474637    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474642    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474644    2571 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474648    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474652    2571 flags.go:64] FLAG: --tls-min-version=""
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474654    2571 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474657    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474660    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474662    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474665    2571 flags.go:64] FLAG: --v="2"
Sep 17 11:51:24.483312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474669    2571 flags.go:64] FLAG: --version="false"
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474672    2571 flags.go:64] FLAG: --vmodule=""
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474676    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.474679    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474801    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474805    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474808    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474811    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474814    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474817    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474820    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474822    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474825    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474828    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474831    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474833    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474836    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474842    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474845    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474848    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 11:51:24.483975 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474851    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474853    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474856    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474858    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474861    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474865    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474868    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474870    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474873    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474875    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474878    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474880    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474883    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474886    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474888    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474890    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474893    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474895    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474898    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474900    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 11:51:24.484522 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474903    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474905    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474908    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474910    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474913    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474916    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474918    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474921    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474923    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474927    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474929    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474932    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474934    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474937    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474940    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474942    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474945    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474949    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474951    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474954    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 11:51:24.485057 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474959    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474962    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474964    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474967    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474969    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474972    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474974    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474977    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474981    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474984    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474987    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474990    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474993    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474996    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.474999    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475001    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475004    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475007    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475009    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 11:51:24.485604 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475012    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475015    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475036    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475039    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475042    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475045    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475047    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475050    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475052    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475055    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475059    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475061    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475064    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475067    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475069    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475072    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475075    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475077    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475080    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475082    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 11:51:24.486152 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475085    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475087    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475090    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.475092    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.475097    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.483744    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.483758    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.484584    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.484592    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484646    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484651    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484655    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484659    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484663    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 11:51:24.486680 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484666    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484669    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484672    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484675    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484678    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484681    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484684    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484687    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484690    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484692    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484695    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484697    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484700    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484702    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484706    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484709    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484713    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484716    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484718    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 11:51:24.487149 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484722    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484725    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484727    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484730    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484734    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484737    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484740    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484742    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484744    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484747    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484750    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484752    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484755    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484757    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484760    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484763    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484765    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484768    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484770    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 11:51:24.487659 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484773    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484775    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484778    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484780    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484783    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484786    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484788    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484791    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484793    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484796    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484798    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484801    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484804    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484806    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484809    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484811    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484814    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484817    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484819    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484822    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 11:51:24.488163 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484824    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484827    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484829    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484832    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484834    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484837    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484839    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484841    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484844    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484847    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484849    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484852    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484854    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484857    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484859    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484862    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484865    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484869    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484872    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484875    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 11:51:24.488688 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484878    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484881    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484884    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484886    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484889    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484891    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484894    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484896    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484899    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484902    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484905    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484907    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484910    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484913    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484915    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 11:51:24.489213 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.484918    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.484923    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485053    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485059    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485062    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485065    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485068    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485071    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485073    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485076    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485078    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485081    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485084    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485086    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485091    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 11:51:24.489606 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485095    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485098    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485100    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485103    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485106    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485108    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485111    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485113    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485116    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485118    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485122    2571 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485124    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485127    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485130    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485132    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485135    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485137    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485140    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485142    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485145    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 11:51:24.489990 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485147    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485150    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485152    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485155    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485157    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485159    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485162    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485164    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485167    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485169    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485171    2571 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485174    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485177    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485179    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485181    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485184    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485186    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485189    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485191    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485194    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 11:51:24.490510 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485196    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485198    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485201    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485204    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485207    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485209    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485212    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485215    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485218    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485221    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485224    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485226    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485229    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485231    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485233    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485236    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485238    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485241    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485243    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 11:51:24.491018 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485246    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485249    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485252    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485255    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485257    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485260    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485263    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485266    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485268    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485271    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485273    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485275    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485278    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485280    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485283    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485287    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485290    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485293    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485295    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 11:51:24.491581 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485298    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485301    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485303    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485306    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485308    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485311    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485313    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:24.485316    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.485321    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.485425    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.487609    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.488572    2571 server.go:1019] "Starting client certificate rotation"
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.488665    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 11:51:24.492125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.488705    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 11:51:24.492467 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.491321    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 11:51:24.492467 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.492402    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 11:51:24.504259 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.504241    2571 log.go:25] "Validated CRI v1 runtime API"
Sep 17 11:51:24.508267 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.508246    2571 log.go:25] "Validated CRI v1 image API"
Sep 17 11:51:24.509252 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.509231    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 11:51:24.514822 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.514803    2571 fs.go:135] Filesystem UUIDs: map[5af93a40-eaa5-4e80-9cf2-09be1f0e620b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8a13421f-2f6c-404a-9e06-3f9fa52c522d:/dev/nvme0n1p4]
Sep 17 11:51:24.514891 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.514821    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 11:51:24.519619 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.519599    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 11:51:24.522144 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.522041    2571 manager.go:216] Machine: {Timestamp:2026-09-17 11:51:24.519838698 +0000 UTC m=+0.370029108 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3069208 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c4c9b62afcb6f4705368d69cb67c7 SystemUUID:ec2c4c9b-62af-cb6f-4705-368d69cb67c7 BootID:ed3aebfd-102f-4756-a2d1-a29b10b3f275 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c6:08:a3:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c6:08:a3:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:e2:c8:7c:ab:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 11:51:24.522215 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.522150    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 11:51:24.522257 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.522244    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 11:51:24.526311 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.526129    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 11:51:24.526480 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.526317    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 11:51:24.527134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.527115    2571 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 11:51:24.527134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.527140    2571 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 11:51:24.527225 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.527151    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 11:51:24.527899 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.527887    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 11:51:24.528945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.528932    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 11:51:24.532299 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532285    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 11:51:24.532435 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532424    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 11:51:24.532495 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532463    2571 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 11:51:24.532495 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532477    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 11:51:24.532495 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532491    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 11:51:24.532641 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532504    2571 kubelet.go:398] "Adding apiserver pod source"
Sep 17 11:51:24.532641 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532516    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 11:51:24.532895 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532882    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 11:51:24.533050 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.532907    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 11:51:24.535532 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.535516    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 11:51:24.537721 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.537707    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 11:51:24.537780 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.537737    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 11:51:24.540175 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540163    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 11:51:24.540226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540186    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 11:51:24.540226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540197    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 11:51:24.540226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540206    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 11:51:24.540226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540217    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 11:51:24.540226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540223    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 11:51:24.540374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540236    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 11:51:24.540374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540242    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 11:51:24.540374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540248    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 11:51:24.540374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540253    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 11:51:24.540374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540262    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 11:51:24.540374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.540268    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 11:51:24.541066 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.541057    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 11:51:24.541066 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.541066    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 11:51:24.544753 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.544730    2571 server.go:1268] "Started kubelet"
Sep 17 11:51:24.544848 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.544778    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 11:51:24.545076 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.544903    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 11:51:24.545243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.545224    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 11:51:24.545583 ip-10-0-142-23 systemd[1]: Started Kubernetes Kubelet.
Sep 17 11:51:24.546114 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.546098    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 11:51:24.546188 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.546124    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 11:51:24.546347 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.546194    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 11:51:24.547146 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.547132    2571 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 11:51:24.547248 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.547224    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 11:51:24.550275 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.550241    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 11:51:24.552933 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.552889    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 11:51:24.554236 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.552748    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-23.ec2.internal.18d619733604a8c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-23.ec2.internal,UID:ip-10-0-142-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-23.ec2.internal,},FirstTimestamp:2026-09-17 11:51:24.544559305 +0000 UTC m=+0.394749715,LastTimestamp:2026-09-17 11:51:24.544559305 +0000 UTC m=+0.394749715,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-23.ec2.internal,}"
Sep 17 11:51:24.554442 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.554426    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 11:51:24.554557 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.554539    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:24.555136 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.555112    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hlsdk"
Sep 17 11:51:24.555834 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.555819    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 11:51:24.555834 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.555824    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 11:51:24.555905 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.555841    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 11:51:24.555938 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.555921    2571 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 11:51:24.555938 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.555933    2571 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 11:51:24.556786 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.556768    2571 factory.go:55] Registering systemd factory
Sep 17 11:51:24.556786 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.556788    2571 factory.go:223] Registration of the systemd container factory successfully
Sep 17 11:51:24.557137 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.557125    2571 factory.go:153] Registering CRI-O factory
Sep 17 11:51:24.557183 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.557140    2571 factory.go:223] Registration of the crio container factory successfully
Sep 17 11:51:24.557214 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.557193    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 11:51:24.557214 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.557212    2571 factory.go:103] Registering Raw factory
Sep 17 11:51:24.557272 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.557226    2571 manager.go:1196] Started watching for new ooms in manager
Sep 17 11:51:24.557555 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.557546    2571 manager.go:349] Starting recovery of all containers
Sep 17 11:51:24.559705 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.559675    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 11:51:24.562068 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.562040    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hlsdk"
Sep 17 11:51:24.563574 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.563539    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 11:51:24.564384 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.564350    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 11:51:24.571108 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.571091    2571 manager.go:354] Recovery completed
Sep 17 11:51:24.574905 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.574894    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.576547 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.576529    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.576630 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.576562    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.576630 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.576576    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.577167 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577153    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 11:51:24.577167 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577165    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 11:51:24.577270 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577189    2571 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 11:51:24.577270 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577158    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.577863 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577842    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.577898 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577875    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.577898 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.577887    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.578517 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.578504    2571 policy_none.go:49] "None policy: Start"
Sep 17 11:51:24.578559 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.578522    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 11:51:24.578559 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.578532    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 11:51:24.579285 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.579211    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-23.ec2.internal.18d6197337ecbe4b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-23.ec2.internal,UID:ip-10-0-142-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-23.ec2.internal,},FirstTimestamp:2026-09-17 11:51:24.576546379 +0000 UTC m=+0.426736790,LastTimestamp:2026-09-17 11:51:24.576546379 +0000 UTC m=+0.426736790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-23.ec2.internal,}"
Sep 17 11:51:24.579547 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.579536    2571 policy_none.go:47] "Start"
Sep 17 11:51:24.622355 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622339    2571 manager.go:337] "Starting Device Plugin manager"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.622373    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622387    2571 server.go:87] "Starting device plugin registration server"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622621    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622633    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622725    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622812    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.622822    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.623362    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 11:51:24.646600 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.623410    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:24.669237 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.669222    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 11:51:24.669294 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.669265    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 11:51:24.669294 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.669283    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 11:51:24.669364 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.669315    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 11:51:24.671641 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.671621    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 11:51:24.723560 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.723518    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.724315 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.724300    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.724371 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.724344    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.724371 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.724355    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.724455 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.724373    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.733164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.733149    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.733244 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.733173    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-23.ec2.internal\": node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:24.751209 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.751190    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:24.769747 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.769718    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"]
Sep 17 11:51:24.769834 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.769792    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.770512 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.770498    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.770586 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.770523    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.770586 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.770536    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.772681 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.772667    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.772809 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.772795    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.772844 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.772827    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.773311 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.773297    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.773387 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.773320    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.773387 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.773333    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.773447 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.773400    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.773447 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.773427    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.773447 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.773440    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.775507 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.775491    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.775587 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.775516    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 11:51:24.776161 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.776148    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 11:51:24.776239 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.776173    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 11:51:24.776239 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.776214    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeHasSufficientPID"
Sep 17 11:51:24.809569 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.809549    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-23.ec2.internal\" not found" node="ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.813272 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.813258    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-23.ec2.internal\" not found" node="ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.852059 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.852044    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:24.858475 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.858456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a04d53566417fcaa6ae099a99327d40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"3a04d53566417fcaa6ae099a99327d40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.858530 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.858481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a04d53566417fcaa6ae099a99327d40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"3a04d53566417fcaa6ae099a99327d40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.858530 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.858498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d26798fc08046ac5b88fca666bd8d47f-config\") pod \"kube-apiserver-proxy-ip-10-0-142-23.ec2.internal\" (UID: \"d26798fc08046ac5b88fca666bd8d47f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.953177 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:24.953001    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:24.959427 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.959407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a04d53566417fcaa6ae099a99327d40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"3a04d53566417fcaa6ae099a99327d40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.959481 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.959433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a04d53566417fcaa6ae099a99327d40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"3a04d53566417fcaa6ae099a99327d40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.959481 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.959449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d26798fc08046ac5b88fca666bd8d47f-config\") pod \"kube-apiserver-proxy-ip-10-0-142-23.ec2.internal\" (UID: \"d26798fc08046ac5b88fca666bd8d47f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.959553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.959495    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d26798fc08046ac5b88fca666bd8d47f-config\") pod \"kube-apiserver-proxy-ip-10-0-142-23.ec2.internal\" (UID: \"d26798fc08046ac5b88fca666bd8d47f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.959553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.959518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3a04d53566417fcaa6ae099a99327d40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"3a04d53566417fcaa6ae099a99327d40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:24.959553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:24.959498    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3a04d53566417fcaa6ae099a99327d40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal\" (UID: \"3a04d53566417fcaa6ae099a99327d40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:25.053871 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:25.053812    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:25.111272 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.111256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:25.116538 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.115953    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:25.154620 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:25.154597    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:25.255096 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:25.255069    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:25.355537 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:25.355492    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:25.456102 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:25.456072    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:25.474880 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.474865    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 11:51:25.488346 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.488325    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 11:51:25.488464 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.488447    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 11:51:25.488509 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.488489    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 11:51:25.557470 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:25.557449    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-23.ec2.internal\" not found"
Sep 17 11:51:25.569706 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.569677    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 11:46:25 +0000 UTC" deadline="2028-07-01 15:55:21.49901901 +0000 UTC"
Sep 17 11:51:25.569706 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.569703    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15676h3m55.929318495s"
Sep 17 11:51:25.652963 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.652915    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 11:51:25.655115 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.655098    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:25.666634 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.666619    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 11:51:25.667560 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.667548    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal"
Sep 17 11:51:25.677289 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.677276    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 11:51:25.862748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:25.862725    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 11:51:26.023952 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:26.023853    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a04d53566417fcaa6ae099a99327d40.slice/crio-30f030e74cfdcad35fd3f7af627df1fcfb8aaf4e6428220bc2267853f6a0c1dc WatchSource:0}: Error finding container 30f030e74cfdcad35fd3f7af627df1fcfb8aaf4e6428220bc2267853f6a0c1dc: Status 404 returned error can't find the container with id 30f030e74cfdcad35fd3f7af627df1fcfb8aaf4e6428220bc2267853f6a0c1dc
Sep 17 11:51:26.024868 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:26.024831    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26798fc08046ac5b88fca666bd8d47f.slice/crio-b06d5d6791c6243b3b484b8d648538515085217e4ee6b38e4733a296d3d6ad7b WatchSource:0}: Error finding container b06d5d6791c6243b3b484b8d648538515085217e4ee6b38e4733a296d3d6ad7b: Status 404 returned error can't find the container with id b06d5d6791c6243b3b484b8d648538515085217e4ee6b38e4733a296d3d6ad7b
Sep 17 11:51:26.028569 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:26.028553    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 11:51:27.691835 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.691811    2571 apiserver.go:52] "Watching apiserver"
Sep 17 11:51:27.698909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.698883    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 11:51:27.699338 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.699308    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-dqdmp","openshift-dns/node-resolver-tbqrr","openshift-image-registry/node-ca-4vxzb","openshift-multus/multus-additional-cni-plugins-n4w2c","openshift-network-diagnostics/network-check-target-jxvq8","kube-system/global-pull-secret-syncer-n7lj9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal","openshift-multus/multus-xnrck","openshift-multus/network-metrics-daemon-2hdbd","openshift-network-operator/iptables-alerter-s6fpx","openshift-ovn-kubernetes/ovnkube-node-9kddg","kube-system/konnectivity-agent-rphmw","kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"]
Sep 17 11:51:27.703104 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.703081    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.705282 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.705263    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.705780 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.705729    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 11:51:27.705899 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.705810    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bbrw8\""
Sep 17 11:51:27.705899 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.705838    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.706010 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.705980    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.707637 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.707591    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 11:51:27.708134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.707652    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.708134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.707596    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 11:51:27.708134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.707678    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.708134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.708111    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 11:51:27.708372 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.708271    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p42q2\""
Sep 17 11:51:27.708372 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.708282    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 11:51:27.708372 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.708322    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.710145 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.710120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.710835 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.710809    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.710945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.710814    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.710945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.710841    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 11:51:27.710945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.710883    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sppzg\""
Sep 17 11:51:27.711307 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.711291    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 11:51:27.712268 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.712241    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:27.712393 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.712311    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:27.712539 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.712512    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.712678 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.712597    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 11:51:27.712678 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.712630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.713017 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.712999    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 11:51:27.713419 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.713400    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fx2s8\""
Sep 17 11:51:27.713525 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.713507    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 11:51:27.714606 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.714587    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.717020 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.716995    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c6gfr\""
Sep 17 11:51:27.717344 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.717317    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.717555 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.717536    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 11:51:27.717640 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.717578    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.717832 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.717812    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:27.717937 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.717913    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:27.720138 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.720117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.722425 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.722402    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.723990 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.723970    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.724260 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.724244    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pw7sh\""
Sep 17 11:51:27.724315 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.724266    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.724740 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.724717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.724872 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.724855    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 11:51:27.724983 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.724959    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gqmtg\""
Sep 17 11:51:27.725045 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8tw\" (UniqueName: \"kubernetes.io/projected/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-kube-api-access-pr8tw\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.725096 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-sys-fs\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.725146 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725121    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-systemd\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725208 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725157    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725208 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-cni-netd\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.725281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlv86\" (UniqueName: \"kubernetes.io/projected/cb96907f-98a2-49a8-9e2f-95896d3951ba-kube-api-access-rlv86\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.725281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-kubelet\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-etc-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdc9e219-6385-4468-a438-8ee1c63bde48-host\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.725391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmrr\" (UniqueName: \"kubernetes.io/projected/cdc9e219-6385-4468-a438-8ee1c63bde48-kube-api-access-dkmrr\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.725391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.725538 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-etc-selinux\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.725538 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb96907f-98a2-49a8-9e2f-95896d3951ba-host-slash\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.725538 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725443    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-systemd-units\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725538 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725468    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-node-log\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725538 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-cni-bin\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-ovnkube-config\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-ovnkube-script-lib\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725665    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725674    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-registration-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb96907f-98a2-49a8-9e2f-95896d3951ba-iptables-alerter-script\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-log-socket\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725825    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-env-overrides\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.725856 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725854    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f8928c0-2147-4a38-9c66-9a81859566e7-ovn-node-metrics-cert\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cnibin\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725894    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hp6m\" (UniqueName: \"kubernetes.io/projected/469fcf21-42ed-40f7-99ae-023955a52604-kube-api-access-2hp6m\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.725941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-run-netns\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726058    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjdp7\" (UniqueName: \"kubernetes.io/projected/9f8928c0-2147-4a38-9c66-9a81859566e7-kube-api-access-gjdp7\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-socket-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726141    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-device-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-slash\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726208    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-var-lib-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-ovn\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.726349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.726238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdc9e219-6385-4468-a438-8ee1c63bde48-serviceca\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.727209 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.727186    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4pj7l\""
Sep 17 11:51:27.727340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.727251    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.727340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.727317    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 11:51:27.727586 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.727568    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 11:51:27.729384 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.729360    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 11:51:27.729704 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.729680    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.729859 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.729734    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:27.730095 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.729985    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kld6d\""
Sep 17 11:51:27.730095 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.730009    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 11:51:27.751835 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.751818    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2m2n"
Sep 17 11:51:27.762323 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.762303    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2m2n"
Sep 17 11:51:27.814311 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.814290    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 11:51:27.826574 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.826634 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.826634 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlv86\" (UniqueName: \"kubernetes.io/projected/cb96907f-98a2-49a8-9e2f-95896d3951ba-kube-api-access-rlv86\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.826634 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btwl4\" (UniqueName: \"kubernetes.io/projected/a0295d97-4c7e-4d87-864c-ff949309f483-kube-api-access-btwl4\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.826800 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826662    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.826800 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826686    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-system-cni-dir\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.826800 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79a943e6-502a-4942-b4a5-bf052fcba819-agent-certs\") pod \"konnectivity-agent-rphmw\" (UID: \"79a943e6-502a-4942-b4a5-bf052fcba819\") " pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.826800 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-cni-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-conf-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826846    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-kubelet\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826869    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdc9e219-6385-4468-a438-8ee1c63bde48-host\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-kubelet\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-etc-selinux\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826962    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdc9e219-6385-4468-a438-8ee1c63bde48-host\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826966    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-kubernetes\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.826997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.826989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79a943e6-502a-4942-b4a5-bf052fcba819-konnectivity-ca\") pod \"konnectivity-agent-rphmw\" (UID: \"79a943e6-502a-4942-b4a5-bf052fcba819\") " pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c979f41e-7d67-4120-be8f-ab41e67cfc71-dbus\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827023    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-etc-selinux\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-cni-bin\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827061    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-ovnkube-config\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-ovnkube-script-lib\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827094    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-cni-bin\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-run\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827146    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-host\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-log-socket\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-env-overrides\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hp6m\" (UniqueName: \"kubernetes.io/projected/469fcf21-42ed-40f7-99ae-023955a52604-kube-api-access-2hp6m\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827279    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0295d97-4c7e-4d87-864c-ff949309f483-hosts-file\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.827356 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827303    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-system-cni-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827321    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-log-socket\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827876    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.827910    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-env-overrides\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-socket-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.828119 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828108    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-ovnkube-config\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-socket-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9f8928c0-2147-4a38-9c66-9a81859566e7-ovnkube-script-lib\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-device-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjt9\" (UniqueName: \"kubernetes.io/projected/1a4ccec6-1194-4767-a950-5202100a5700-kube-api-access-wwjt9\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828317    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-daemon-config\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828324    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-device-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-var-lib-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828394    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-ovn\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828437    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdc9e219-6385-4468-a438-8ee1c63bde48-serviceca\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828397    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-var-lib-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkr4g\" (UniqueName: \"kubernetes.io/projected/ab3f4936-192b-45e9-bf37-03bc8928f2fa-kube-api-access-tkr4g\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-modprobe-d\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c979f41e-7d67-4120-be8f-ab41e67cfc71-kubelet-config\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8tw\" (UniqueName: \"kubernetes.io/projected/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-kube-api-access-pr8tw\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a4ccec6-1194-4767-a950-5202100a5700-etc-tuned\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-cnibin\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828713    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-cni-binary-copy\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-cni-netd\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.828787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828754    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-ovn\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-cni-multus\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-cni-netd\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.828887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-etc-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmrr\" (UniqueName: \"kubernetes.io/projected/cdc9e219-6385-4468-a438-8ee1c63bde48-kube-api-access-dkmrr\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb96907f-98a2-49a8-9e2f-95896d3951ba-host-slash\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829130    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-etc-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysctl-d\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.829274 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb96907f-98a2-49a8-9e2f-95896d3951ba-host-slash\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.829679 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-socket-dir-parent\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.829679 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-netns\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.829679 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-cni-bin\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.829679 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829592    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-systemd-units\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829679 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829621    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-node-log\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829679 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-systemd\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cdc9e219-6385-4468-a438-8ee1c63bde48-serviceca\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829708    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-var-lib-kubelet\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829754    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-node-log\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-multus-certs\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829858    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-systemd-units\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.829964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.829970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-registration-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb96907f-98a2-49a8-9e2f-95896d3951ba-iptables-alerter-script\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysconfig\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0295d97-4c7e-4d87-864c-ff949309f483-tmp-dir\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f8928c0-2147-4a38-9c66-9a81859566e7-ovn-node-metrics-cert\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830262    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cnibin\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.830325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830296    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-k8s-cni-cncf-io\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-run-netns\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830392    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cni-binary-copy\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjdp7\" (UniqueName: \"kubernetes.io/projected/9f8928c0-2147-4a38-9c66-9a81859566e7-kube-api-access-gjdp7\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-kubelet\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xbg\" (UniqueName: \"kubernetes.io/projected/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-kube-api-access-p2xbg\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830554    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-slash\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysctl-conf\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.830748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-run-netns\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-registration-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831024    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.830626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a4ccec6-1194-4767-a950-5202100a5700-tmp\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-cnibin\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-hostroot\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831106    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831119    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-etc-kubernetes\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831140    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-host-slash\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.831204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-openvswitch\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831155    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-sys-fs\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831242    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-sys\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-lib-modules\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/469fcf21-42ed-40f7-99ae-023955a52604-sys-fs\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831305    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-systemd\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9f8928c0-2147-4a38-9c66-9a81859566e7-run-systemd\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.832053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.831578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb96907f-98a2-49a8-9e2f-95896d3951ba-iptables-alerter-script\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.834076 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.834034    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"3a04d53566417fcaa6ae099a99327d40","Type":"ContainerStarted","Data":"30f030e74cfdcad35fd3f7af627df1fcfb8aaf4e6428220bc2267853f6a0c1dc"}
Sep 17 11:51:27.835135 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.835110    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" event={"ID":"d26798fc08046ac5b88fca666bd8d47f","Type":"ContainerStarted","Data":"b06d5d6791c6243b3b484b8d648538515085217e4ee6b38e4733a296d3d6ad7b"}
Sep 17 11:51:27.835327 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.835313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9f8928c0-2147-4a38-9c66-9a81859566e7-ovn-node-metrics-cert\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.840813 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.840793    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjdp7\" (UniqueName: \"kubernetes.io/projected/9f8928c0-2147-4a38-9c66-9a81859566e7-kube-api-access-gjdp7\") pod \"ovnkube-node-9kddg\" (UID: \"9f8928c0-2147-4a38-9c66-9a81859566e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:27.840921 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.840902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlv86\" (UniqueName: \"kubernetes.io/projected/cb96907f-98a2-49a8-9e2f-95896d3951ba-kube-api-access-rlv86\") pod \"iptables-alerter-s6fpx\" (UID: \"cb96907f-98a2-49a8-9e2f-95896d3951ba\") " pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:27.840978 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.840905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmrr\" (UniqueName: \"kubernetes.io/projected/cdc9e219-6385-4468-a438-8ee1c63bde48-kube-api-access-dkmrr\") pod \"node-ca-4vxzb\" (UID: \"cdc9e219-6385-4468-a438-8ee1c63bde48\") " pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:27.842111 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.842095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8tw\" (UniqueName: \"kubernetes.io/projected/5aa4570a-8a52-4cb8-b8da-c8313aab0cc1-kube-api-access-pr8tw\") pod \"multus-additional-cni-plugins-n4w2c\" (UID: \"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1\") " pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:27.844247 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.844224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hp6m\" (UniqueName: \"kubernetes.io/projected/469fcf21-42ed-40f7-99ae-023955a52604-kube-api-access-2hp6m\") pod \"aws-ebs-csi-driver-node-7vltn\" (UID: \"469fcf21-42ed-40f7-99ae-023955a52604\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:27.844345 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.844333    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:27.844382 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.844348    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:27.844382 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.844356    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:27.844501 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.844426    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:51:28.344411878 +0000 UTC m=+3.036859386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:27.931969 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.931948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0295d97-4c7e-4d87-864c-ff949309f483-hosts-file\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.932061 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.931972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-system-cni-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932061 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.931995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjt9\" (UniqueName: \"kubernetes.io/projected/1a4ccec6-1194-4767-a950-5202100a5700-kube-api-access-wwjt9\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932061 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-daemon-config\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932061 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkr4g\" (UniqueName: \"kubernetes.io/projected/ab3f4936-192b-45e9-bf37-03bc8928f2fa-kube-api-access-tkr4g\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:27.932061 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a0295d97-4c7e-4d87-864c-ff949309f483-hosts-file\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-system-cni-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-modprobe-d\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932169    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c979f41e-7d67-4120-be8f-ab41e67cfc71-kubelet-config\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932195    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a4ccec6-1194-4767-a950-5202100a5700-etc-tuned\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932216    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-cnibin\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-cni-binary-copy\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-modprobe-d\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c979f41e-7d67-4120-be8f-ab41e67cfc71-kubelet-config\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-cni-multus\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-cnibin\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysctl-d\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-socket-dir-parent\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-netns\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-cni-bin\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932344    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-cni-multus\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-systemd\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932434    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysctl-d\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932453    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-netns\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-var-lib-kubelet\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932480    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-cni-bin\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-socket-dir-parent\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-multus-certs\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932541    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-systemd\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-var-lib-kubelet\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysconfig\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-multus-certs\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-daemon-config\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.932859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0295d97-4c7e-4d87-864c-ff949309f483-tmp-dir\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-k8s-cni-cncf-io\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysconfig\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.932625    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932666    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-run-k8s-cni-cncf-io\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.932710    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:51:28.432695093 +0000 UTC m=+3.125142607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-kubelet\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932735    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-cni-binary-copy\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932754    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xbg\" (UniqueName: \"kubernetes.io/projected/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-kube-api-access-p2xbg\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932793    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-host-var-lib-kubelet\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysctl-conf\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a4ccec6-1194-4767-a950-5202100a5700-tmp\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-hostroot\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0295d97-4c7e-4d87-864c-ff949309f483-tmp-dir\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932954    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-sysctl-conf\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-etc-kubernetes\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932987    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-hostroot\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.932994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-sys\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.933639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933012    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-lib-modules\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-etc-kubernetes\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwl4\" (UniqueName: \"kubernetes.io/projected/a0295d97-4c7e-4d87-864c-ff949309f483-kube-api-access-btwl4\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79a943e6-502a-4942-b4a5-bf052fcba819-agent-certs\") pod \"konnectivity-agent-rphmw\" (UID: \"79a943e6-502a-4942-b4a5-bf052fcba819\") " pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-sys\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-cni-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-conf-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-lib-modules\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933115    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-kubernetes\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933132    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-cni-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79a943e6-502a-4942-b4a5-bf052fcba819-konnectivity-ca\") pod \"konnectivity-agent-rphmw\" (UID: \"79a943e6-502a-4942-b4a5-bf052fcba819\") " pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-multus-conf-dir\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c979f41e-7d67-4120-be8f-ab41e67cfc71-dbus\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-run\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-host\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-host\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.933335    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:27.934470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933354    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-run\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934993 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:27.933384    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:51:28.433367541 +0000 UTC m=+3.125815076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:27.934993 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933410    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c979f41e-7d67-4120-be8f-ab41e67cfc71-dbus\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:27.934993 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a4ccec6-1194-4767-a950-5202100a5700-etc-kubernetes\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.934993 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.933643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/79a943e6-502a-4942-b4a5-bf052fcba819-konnectivity-ca\") pod \"konnectivity-agent-rphmw\" (UID: \"79a943e6-502a-4942-b4a5-bf052fcba819\") " pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.934993 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.934419    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1a4ccec6-1194-4767-a950-5202100a5700-etc-tuned\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.935148 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.935105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a4ccec6-1194-4767-a950-5202100a5700-tmp\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.935512 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.935497    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/79a943e6-502a-4942-b4a5-bf052fcba819-agent-certs\") pod \"konnectivity-agent-rphmw\" (UID: \"79a943e6-502a-4942-b4a5-bf052fcba819\") " pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:27.941723 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.941697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjt9\" (UniqueName: \"kubernetes.io/projected/1a4ccec6-1194-4767-a950-5202100a5700-kube-api-access-wwjt9\") pod \"tuned-dqdmp\" (UID: \"1a4ccec6-1194-4767-a950-5202100a5700\") " pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:27.941990 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.941946    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xbg\" (UniqueName: \"kubernetes.io/projected/0c3edc87-bb14-4df4-970a-8c5eb5ec9621-kube-api-access-p2xbg\") pod \"multus-xnrck\" (UID: \"0c3edc87-bb14-4df4-970a-8c5eb5ec9621\") " pod="openshift-multus/multus-xnrck"
Sep 17 11:51:27.942589 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.942571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btwl4\" (UniqueName: \"kubernetes.io/projected/a0295d97-4c7e-4d87-864c-ff949309f483-kube-api-access-btwl4\") pod \"node-resolver-tbqrr\" (UID: \"a0295d97-4c7e-4d87-864c-ff949309f483\") " pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:27.942741 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:27.942725    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkr4g\" (UniqueName: \"kubernetes.io/projected/ab3f4936-192b-45e9-bf37-03bc8928f2fa-kube-api-access-tkr4g\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:28.016244 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.016226    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s6fpx"
Sep 17 11:51:28.024863 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.024837    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb96907f_98a2_49a8_9e2f_95896d3951ba.slice/crio-34bfd54e2abfe345a12568cc1baad1d88fe02f9163ee515d872a7b8f50a3a906 WatchSource:0}: Error finding container 34bfd54e2abfe345a12568cc1baad1d88fe02f9163ee515d872a7b8f50a3a906: Status 404 returned error can't find the container with id 34bfd54e2abfe345a12568cc1baad1d88fe02f9163ee515d872a7b8f50a3a906
Sep 17 11:51:28.025943 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.025748    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:28.034637 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.034450    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4vxzb"
Sep 17 11:51:28.035078 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.035058    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8928c0_2147_4a38_9c66_9a81859566e7.slice/crio-0484f58a14d623d63a338e8ca4bdd050f22ed4e1dcb0ec677aa0b4d02cdd3a17 WatchSource:0}: Error finding container 0484f58a14d623d63a338e8ca4bdd050f22ed4e1dcb0ec677aa0b4d02cdd3a17: Status 404 returned error can't find the container with id 0484f58a14d623d63a338e8ca4bdd050f22ed4e1dcb0ec677aa0b4d02cdd3a17
Sep 17 11:51:28.039718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.039700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n4w2c"
Sep 17 11:51:28.043903 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.043831    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc9e219_6385_4468_a438_8ee1c63bde48.slice/crio-0f291411b23e98ff4bf7e13e919401d7a0d521fcafabca8158aaf6f3b1578e38 WatchSource:0}: Error finding container 0f291411b23e98ff4bf7e13e919401d7a0d521fcafabca8158aaf6f3b1578e38: Status 404 returned error can't find the container with id 0f291411b23e98ff4bf7e13e919401d7a0d521fcafabca8158aaf6f3b1578e38
Sep 17 11:51:28.044939 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.044923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn"
Sep 17 11:51:28.047406 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.047188    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 11:51:28.049703 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.049681    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa4570a_8a52_4cb8_b8da_c8313aab0cc1.slice/crio-5cfbca6e8881a1304b0b820695cde99bc89be00a7d33b40fb536dda82767a425 WatchSource:0}: Error finding container 5cfbca6e8881a1304b0b820695cde99bc89be00a7d33b40fb536dda82767a425: Status 404 returned error can't find the container with id 5cfbca6e8881a1304b0b820695cde99bc89be00a7d33b40fb536dda82767a425
Sep 17 11:51:28.051026 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.050807    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqdmp"
Sep 17 11:51:28.054447 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.054428    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469fcf21_42ed_40f7_99ae_023955a52604.slice/crio-f00823a514bb09e0224ec4533ed4ae9275bf12fc5c1e992b5259f180185447e0 WatchSource:0}: Error finding container f00823a514bb09e0224ec4533ed4ae9275bf12fc5c1e992b5259f180185447e0: Status 404 returned error can't find the container with id f00823a514bb09e0224ec4533ed4ae9275bf12fc5c1e992b5259f180185447e0
Sep 17 11:51:28.057805 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.057291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tbqrr"
Sep 17 11:51:28.062647 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.062629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:28.067853 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.067835    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xnrck"
Sep 17 11:51:28.069220 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.069173    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0295d97_4c7e_4d87_864c_ff949309f483.slice/crio-8bf11e1b68cdd6450c5041d8f69e27efb118243f16c00dff9778c80f725e7f81 WatchSource:0}: Error finding container 8bf11e1b68cdd6450c5041d8f69e27efb118243f16c00dff9778c80f725e7f81: Status 404 returned error can't find the container with id 8bf11e1b68cdd6450c5041d8f69e27efb118243f16c00dff9778c80f725e7f81
Sep 17 11:51:28.072741 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.072720    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a943e6_502a_4942_b4a5_bf052fcba819.slice/crio-54af32cff1a9fcbd81aba64336370da2b6de2b39bf1ac9a4203eb3c0682fc373 WatchSource:0}: Error finding container 54af32cff1a9fcbd81aba64336370da2b6de2b39bf1ac9a4203eb3c0682fc373: Status 404 returned error can't find the container with id 54af32cff1a9fcbd81aba64336370da2b6de2b39bf1ac9a4203eb3c0682fc373
Sep 17 11:51:28.078036 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:51:28.078007    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3edc87_bb14_4df4_970a_8c5eb5ec9621.slice/crio-f08323a76f7b710ff230f2bcf405d5b98cf12112f0eea78a6e5141245f055ec5 WatchSource:0}: Error finding container f08323a76f7b710ff230f2bcf405d5b98cf12112f0eea78a6e5141245f055ec5: Status 404 returned error can't find the container with id f08323a76f7b710ff230f2bcf405d5b98cf12112f0eea78a6e5141245f055ec5
Sep 17 11:51:28.436996 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.436932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:28.436996 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.436965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:28.436996 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.436992    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437084    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437088    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437104    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437122    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437133    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:51:29.437120777 +0000 UTC m=+4.129568288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437134    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437146    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:51:29.437139922 +0000 UTC m=+4.129587432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:28.437186 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:28.437172    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:51:29.437160502 +0000 UTC m=+4.129608015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:28.688409 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.688329    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 11:51:28.765941 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.765834    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 11:46:27 +0000 UTC" deadline="2028-03-02 12:07:49.606003103 +0000 UTC"
Sep 17 11:51:28.765941 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.765890    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12768h16m20.840117031s"
Sep 17 11:51:28.841547 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.841505    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"0484f58a14d623d63a338e8ca4bdd050f22ed4e1dcb0ec677aa0b4d02cdd3a17"}
Sep 17 11:51:28.843267 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.843196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6fpx" event={"ID":"cb96907f-98a2-49a8-9e2f-95896d3951ba","Type":"ContainerStarted","Data":"34bfd54e2abfe345a12568cc1baad1d88fe02f9163ee515d872a7b8f50a3a906"}
Sep 17 11:51:28.844661 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.844575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn" event={"ID":"469fcf21-42ed-40f7-99ae-023955a52604","Type":"ContainerStarted","Data":"f00823a514bb09e0224ec4533ed4ae9275bf12fc5c1e992b5259f180185447e0"}
Sep 17 11:51:28.846714 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.846653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerStarted","Data":"5cfbca6e8881a1304b0b820695cde99bc89be00a7d33b40fb536dda82767a425"}
Sep 17 11:51:28.849432 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.849359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xnrck" event={"ID":"0c3edc87-bb14-4df4-970a-8c5eb5ec9621","Type":"ContainerStarted","Data":"f08323a76f7b710ff230f2bcf405d5b98cf12112f0eea78a6e5141245f055ec5"}
Sep 17 11:51:28.850659 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.850619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rphmw" event={"ID":"79a943e6-502a-4942-b4a5-bf052fcba819","Type":"ContainerStarted","Data":"54af32cff1a9fcbd81aba64336370da2b6de2b39bf1ac9a4203eb3c0682fc373"}
Sep 17 11:51:28.852226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.852182    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tbqrr" event={"ID":"a0295d97-4c7e-4d87-864c-ff949309f483","Type":"ContainerStarted","Data":"8bf11e1b68cdd6450c5041d8f69e27efb118243f16c00dff9778c80f725e7f81"}
Sep 17 11:51:28.853470 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.853420    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqdmp" event={"ID":"1a4ccec6-1194-4767-a950-5202100a5700","Type":"ContainerStarted","Data":"299b92e58f7b454ad42c041481ecb803c56b7767efe65547c7c05707a07bc46f"}
Sep 17 11:51:28.854610 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:28.854571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4vxzb" event={"ID":"cdc9e219-6385-4468-a438-8ee1c63bde48","Type":"ContainerStarted","Data":"0f291411b23e98ff4bf7e13e919401d7a0d521fcafabca8158aaf6f3b1578e38"}
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.445484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.445550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.445603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.445723    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.445802    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:51:31.445782075 +0000 UTC m=+6.138229598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.446186    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.446204    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.446216    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.446263    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:51:31.446247933 +0000 UTC m=+6.138695442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.446334    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:29.446988 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.446367    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:51:31.446356806 +0000 UTC m=+6.138804317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:29.766838 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.766739    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 11:46:27 +0000 UTC" deadline="2028-03-05 17:44:00.101810154 +0000 UTC"
Sep 17 11:51:29.766838 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.766795    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12845h52m30.335020768s"
Sep 17 11:51:29.830459 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.830429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:29.830596 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.830559    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:29.831000 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.830977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:29.831101 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.831078    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:29.831157 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:29.831140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:29.831234 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:29.831217    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:30.886443 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:30.886187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"3a04d53566417fcaa6ae099a99327d40","Type":"ContainerStarted","Data":"7ad8612aa39f771caa2b459a27f2d62774e3eb98735d0ec1898bcd36b7085c43"}
Sep 17 11:51:31.468052 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:31.468009    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:31.468209 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:31.468074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:31.468209 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:31.468123    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:31.468358 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468338    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:31.468422 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468410    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:51:35.468390553 +0000 UTC m=+10.160838077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:31.468849 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468829    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:31.468849 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468853    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:31.469015 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468865    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:31.469015 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468908    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:51:35.468893598 +0000 UTC m=+10.161341106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:31.469015 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.468971    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:31.469015 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.469007    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:51:35.468994128 +0000 UTC m=+10.161441640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:31.828600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:31.828513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:31.828741 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.828664    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:31.829068 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:31.829047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:31.829171 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.829146    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:31.829367 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:31.829351    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:31.829461 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:31.829441    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:33.827671 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:33.827636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:33.828074 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:33.827636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:33.828074 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:33.827778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:33.828074 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:33.827746    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:33.828074 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:33.827866    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:33.828074 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:33.827931    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:35.502404 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:35.502364    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:35.502420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:35.502465    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502538    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502569    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502612    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:51:43.502590392 +0000 UTC m=+18.195037924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502633    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:51:43.502623396 +0000 UTC m=+18.195070907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502800    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502817    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:35.502879 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502828    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:35.503334 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.502890    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:51:43.502873015 +0000 UTC m=+18.195320529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:35.828976 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:35.828265    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:35.828976 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.828378    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:35.828976 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:35.828697    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:35.828976 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.828813    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:35.828976 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:35.828860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:35.829292 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:35.828976    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:37.827967 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:37.827936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:37.828403 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:37.827977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:37.828403 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:37.827936    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:37.828403 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:37.828066    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:37.828403 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:37.828171    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:37.828403 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:37.828250    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:37.901344 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:37.901307    2571 generic.go:356] "Generic (PLEG): container finished" podID="3a04d53566417fcaa6ae099a99327d40" containerID="7ad8612aa39f771caa2b459a27f2d62774e3eb98735d0ec1898bcd36b7085c43" exitCode=0
Sep 17 11:51:37.901488 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:37.901351    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"3a04d53566417fcaa6ae099a99327d40","Type":"ContainerDied","Data":"7ad8612aa39f771caa2b459a27f2d62774e3eb98735d0ec1898bcd36b7085c43"}
Sep 17 11:51:39.828866 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:39.828780    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:39.828866 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:39.828828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:39.829361 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:39.828782    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:39.829361 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:39.828913    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:39.829361 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:39.829007    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:39.829361 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:39.829084    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:41.827761 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:41.827730    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:41.827761 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:41.827745    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:41.828273 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:41.827851    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:41.828273 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:41.827941    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:41.828273 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:41.828011    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:41.828273 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:41.828084    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:43.561861 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:43.561833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:43.561878    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562005    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562017    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562035    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562045    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562065    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:51:59.562049608 +0000 UTC m=+34.254497120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:43.562008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562086    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562087    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:51:59.562071226 +0000 UTC m=+34.254518751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:43.562323 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.562150    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:51:59.562134786 +0000 UTC m=+34.254582305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:43.827587 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:43.827509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:43.827732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:43.827522    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:43.827732 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.827628    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:43.827732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:43.827526    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:43.827732 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.827705    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:43.827962 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:43.827830    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:45.828371 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:45.828337    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:45.828762 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:45.828441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:45.828762 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:45.828448    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:45.828762 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:45.828469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:45.828762 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:45.828554    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:45.828762 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:45.828627    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:47.827882 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.827462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:47.827882 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.827462    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:47.828821 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:47.827894    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:47.828821 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.827469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:47.828821 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:47.827966    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:47.828821 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:47.828066    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:47.921859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.921829    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4vxzb" event={"ID":"cdc9e219-6385-4468-a438-8ee1c63bde48","Type":"ContainerStarted","Data":"bb977d2893d412249c9f6021c1cf580d9166323a9cf1fda16117ec78802419f9"}
Sep 17 11:51:47.926134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.926101    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"f456e82eecf419453a648e31ea21c344a38c2f7ec93b27d1c141ba45594ae269"}
Sep 17 11:51:47.926629 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.926595    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"20fb81b9ca1709c319ef614768dd383826824ee91d60cbf4e99cee3a328c5fb9"}
Sep 17 11:51:47.926724 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.926700    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"3e70580468b740ad11227550e586db1efee19d7bbb4ca521c499926a08bf33d6"}
Sep 17 11:51:47.926827 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.926805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"93ffcbcec844ba2630bc3d2b29ab374327f32126026c411bce5724f29e77df8b"}
Sep 17 11:51:47.927561 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.927033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"488f2e5e8125a8923437d9d9227a1291862a07ef1bd7fc5d5b26569d10fe669f"}
Sep 17 11:51:47.927561 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.927123    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"c06b0dd53b61c0d8276de59247060cc1fbe0f778f7afa0b4fbe0f71f0f058370"}
Sep 17 11:51:47.929235 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.929213    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" event={"ID":"3a04d53566417fcaa6ae099a99327d40","Type":"ContainerStarted","Data":"7452a51c4789797dce5f490aba1200941970b84278b423adb1395e77614d3c6d"}
Sep 17 11:51:47.931832 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.931803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" event={"ID":"d26798fc08046ac5b88fca666bd8d47f","Type":"ContainerStarted","Data":"c0c4f92d4bd9569ab127e1c4af723e666f091fb8e9372c75a1bd986ea24af3d3"}
Sep 17 11:51:47.933462 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.933437    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn" event={"ID":"469fcf21-42ed-40f7-99ae-023955a52604","Type":"ContainerStarted","Data":"9609a3cad712316667313579b3109b8803905a7c4e20a0671317bb3732ec525d"}
Sep 17 11:51:47.935198 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.935174    2571 generic.go:356] "Generic (PLEG): container finished" podID="5aa4570a-8a52-4cb8-b8da-c8313aab0cc1" containerID="880cd16adfcc86326f6f791e17b671982d9d5c6f557c26ceaeb6811ab23dd7fb" exitCode=0
Sep 17 11:51:47.935287 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.935244    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerDied","Data":"880cd16adfcc86326f6f791e17b671982d9d5c6f557c26ceaeb6811ab23dd7fb"}
Sep 17 11:51:47.937299 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.937129    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xnrck" event={"ID":"0c3edc87-bb14-4df4-970a-8c5eb5ec9621","Type":"ContainerStarted","Data":"a049f54e30851b7592ca50586911e7a800a076ac1271813b444aaf53c6bc40e0"}
Sep 17 11:51:47.939413 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.939391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rphmw" event={"ID":"79a943e6-502a-4942-b4a5-bf052fcba819","Type":"ContainerStarted","Data":"90ca062d72e202f250ae0a5318630f7f72f1d22eea8d1042d7b34ead39816a7e"}
Sep 17 11:51:47.941102 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.941070    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tbqrr" event={"ID":"a0295d97-4c7e-4d87-864c-ff949309f483","Type":"ContainerStarted","Data":"ea14e388cc9e2653963b0e341e9d1c155610ac2d167984f6701b0e71f86c3682"}
Sep 17 11:51:47.942416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.942371    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4vxzb" podStartSLOduration=4.142995808 podStartE2EDuration="22.942336426s" totalImagesPullingTime="18.799340618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:47.942314176 +0000 UTC m=+22.634761710" watchObservedRunningTime="2026-09-17 11:51:47.942336426 +0000 UTC m=+22.634783956"
Sep 17 11:51:47.942904 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.942881    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqdmp" event={"ID":"1a4ccec6-1194-4767-a950-5202100a5700","Type":"ContainerStarted","Data":"c8d579b12dbacecdabd519c9a0a939c36377b2df323ee1818eb78cb1261b0e67"}
Sep 17 11:51:47.964004 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.963970    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xnrck" podStartSLOduration=3.083378603 podStartE2EDuration="21.963957653s" totalImagesPullingTime="18.88057905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:47.963226839 +0000 UTC m=+22.655674392" watchObservedRunningTime="2026-09-17 11:51:47.963957653 +0000 UTC m=+22.656405185"
Sep 17 11:51:47.999845 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:47.999810    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tbqrr" podStartSLOduration=4.218677762 podStartE2EDuration="22.999797257s" totalImagesPullingTime="18.781119495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:47.980895418 +0000 UTC m=+22.673342948" watchObservedRunningTime="2026-09-17 11:51:47.999797257 +0000 UTC m=+22.692244806"
Sep 17 11:51:48.000409 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.000377    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rphmw" podStartSLOduration=3.223670876 podStartE2EDuration="22.000367396s" totalImagesPullingTime="18.77669652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:47.999972496 +0000 UTC m=+22.692420028" watchObservedRunningTime="2026-09-17 11:51:48.000367396 +0000 UTC m=+22.692814926"
Sep 17 11:51:48.019735 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.019699    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-23.ec2.internal" podStartSLOduration=22.019688172 podStartE2EDuration="22.019688172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:48.018899634 +0000 UTC m=+22.711347164" watchObservedRunningTime="2026-09-17 11:51:48.019688172 +0000 UTC m=+22.712135701"
Sep 17 11:51:48.036133 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.036101    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-23.ec2.internal" podStartSLOduration=22.036090401 podStartE2EDuration="22.036090401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:48.03572008 +0000 UTC m=+22.728167602" watchObservedRunningTime="2026-09-17 11:51:48.036090401 +0000 UTC m=+22.728537930"
Sep 17 11:51:48.084449 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.084390    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dqdmp" podStartSLOduration=4.278219863 podStartE2EDuration="23.084378798s" totalImagesPullingTime="18.806158935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:48.084048916 +0000 UTC m=+22.776496473" watchObservedRunningTime="2026-09-17 11:51:48.084378798 +0000 UTC m=+22.776826327"
Sep 17 11:51:48.835407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.835384    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 11:51:48.946367 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.946301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn" event={"ID":"469fcf21-42ed-40f7-99ae-023955a52604","Type":"ContainerStarted","Data":"4cdeb9c16617b33b5e7d1efdae4e259b426b41cb8e00a28c31767250ecfc9cd3"}
Sep 17 11:51:48.947801 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.947751    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s6fpx" event={"ID":"cb96907f-98a2-49a8-9e2f-95896d3951ba","Type":"ContainerStarted","Data":"3379f9e1ca76effc7d07ee437e73e8b8d7eee0acef991ab36139e1b002e653a7"}
Sep 17 11:51:48.973296 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:48.973249    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s6fpx" podStartSLOduration=5.144377458 podStartE2EDuration="23.973231313s" totalImagesPullingTime="18.828853855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:48.973030645 +0000 UTC m=+23.665478175" watchObservedRunningTime="2026-09-17 11:51:48.973231313 +0000 UTC m=+23.665678868"
Sep 17 11:51:49.796447 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.792738    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T11:51:48.835403363Z","UUID":"d6636d99-5756-4583-9b75-e46fb4b76407","Handler":null,"Name":"","Endpoint":""}
Sep 17 11:51:49.796667 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.796648    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 11:51:49.797374 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.797351    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 11:51:49.810921 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.810552    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:49.811658 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.811636    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:49.827710 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.827634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:49.827710 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.827647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:49.827710 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.827669    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:49.827936 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:49.827756    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:49.827936 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:49.827911    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:49.828039 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:49.827975    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:49.954615 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.954542    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"ff0b071ec2f8f633ee6715173f2145f143bd84d5f2d9e434083872a095d0d7da"}
Sep 17 11:51:49.955062 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.954797    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:49.955480 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:49.955458    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rphmw"
Sep 17 11:51:50.958542 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:50.958507    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn" event={"ID":"469fcf21-42ed-40f7-99ae-023955a52604","Type":"ContainerStarted","Data":"cde6a9d1cee173797feb50838bcff24350c4c0913ea0cadb79cd95c0726eec04"}
Sep 17 11:51:51.007889 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:51.007837    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7vltn" podStartSLOduration=4.22163772 podStartE2EDuration="26.007814283s" totalImagesPullingTime="21.786176563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:50.995048706 +0000 UTC m=+25.687496237" watchObservedRunningTime="2026-09-17 11:51:51.007814283 +0000 UTC m=+25.700261883"
Sep 17 11:51:51.828024 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:51.827832    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:51.828164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:51.827850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:51.828164 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:51.828117    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:51.828287 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:51.827850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:51.828287 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:51.828189    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:51.828387 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:51.828298    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:53.828273 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.828247    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:53.828929 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.828247    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:53.828929 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:53.828350    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:53.828929 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.828366    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:53.828929 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:53.828443    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:53.828929 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:53.828493    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:53.968552 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.968521    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" event={"ID":"9f8928c0-2147-4a38-9c66-9a81859566e7","Type":"ContainerStarted","Data":"6175048a662ca64b5178ac29860b44dc618a2d20e016def77e8eaf5611adb8b6"}
Sep 17 11:51:53.968814 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.968787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:53.968917 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.968862    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:53.970817 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.970795    2571 generic.go:356] "Generic (PLEG): container finished" podID="5aa4570a-8a52-4cb8-b8da-c8313aab0cc1" containerID="3f141afd5484276652668304392ac63d6f411f67e0642df467c391d07e9396e9" exitCode=0
Sep 17 11:51:53.970915 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.970834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerDied","Data":"3f141afd5484276652668304392ac63d6f411f67e0642df467c391d07e9396e9"}
Sep 17 11:51:53.985271 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:53.985250    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:54.004041 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:54.004004    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg" podStartSLOduration=10.138605006 podStartE2EDuration="29.003993293s" totalImagesPullingTime="18.865388287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:51:54.003876744 +0000 UTC m=+28.696324274" watchObservedRunningTime="2026-09-17 11:51:54.003993293 +0000 UTC m=+28.696440845"
Sep 17 11:51:54.973120 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:54.972961    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:54.989233 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:54.989207    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:51:55.116687 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.116570    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxvq8"]
Sep 17 11:51:55.116867 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.116720    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:55.116867 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:55.116830    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:55.120054 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.119996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7lj9"]
Sep 17 11:51:55.120243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.120111    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:55.120384 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:55.120256    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:55.120997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.120971    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2hdbd"]
Sep 17 11:51:55.121100 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.121082    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:55.121222 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:55.121184    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:55.976747 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.976714    2571 generic.go:356] "Generic (PLEG): container finished" podID="5aa4570a-8a52-4cb8-b8da-c8313aab0cc1" containerID="a1be7d82aa2b8ea616ab318cfdfd1db3d72e7a5a76e2d6e80befeb594dba7b78" exitCode=0
Sep 17 11:51:55.977132 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:55.976798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerDied","Data":"a1be7d82aa2b8ea616ab318cfdfd1db3d72e7a5a76e2d6e80befeb594dba7b78"}
Sep 17 11:51:56.827967 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:56.827820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:56.828059 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:56.827838    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:56.828112 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:56.828068    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:56.828224 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:56.827860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:56.828224 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:56.828159    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:56.828313 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:56.828289    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:56.981151 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:56.981127    2571 generic.go:356] "Generic (PLEG): container finished" podID="5aa4570a-8a52-4cb8-b8da-c8313aab0cc1" containerID="8301097c815ffe8d42656d80cc2687eae232cd9fe8abc73b84845a80c2ac6280" exitCode=0
Sep 17 11:51:56.981531 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:56.981201    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerDied","Data":"8301097c815ffe8d42656d80cc2687eae232cd9fe8abc73b84845a80c2ac6280"}
Sep 17 11:51:58.827874 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:58.827842    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:58.828286 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:58.827844    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:58.828286 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:58.827973    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2hdbd" podUID="ab3f4936-192b-45e9-bf37-03bc8928f2fa"
Sep 17 11:51:58.828286 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:58.827851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:58.828286 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:58.828046    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxvq8" podUID="9ee48424-7ced-43b6-b473-b6de22e6b53f"
Sep 17 11:51:58.828286 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:58.828135    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7lj9" podUID="c979f41e-7d67-4120-be8f-ab41e67cfc71"
Sep 17 11:51:59.586330 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.586303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:51:59.586490 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.586338    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:51:59.586490 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.586407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:51:59.586490 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586442    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:59.586490 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586485    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:59.586649 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586497    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:52:31.586480929 +0000 UTC m=+66.278928437 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 11:51:59.586649 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586529    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret podName:c979f41e-7d67-4120-be8f-ab41e67cfc71 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:31.586514057 +0000 UTC m=+66.278961564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret") pod "global-pull-secret-syncer-n7lj9" (UID: "c979f41e-7d67-4120-be8f-ab41e67cfc71") : object "kube-system"/"original-pull-secret" not registered
Sep 17 11:51:59.586649 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586554    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 11:51:59.586649 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586572    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 11:51:59.586649 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586583    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vx68v for pod openshift-network-diagnostics/network-check-target-jxvq8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:59.586649 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.586632    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v podName:9ee48424-7ced-43b6-b473-b6de22e6b53f nodeName:}" failed. No retries permitted until 2026-09-17 11:52:31.58662201 +0000 UTC m=+66.279069523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vx68v" (UniqueName: "kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v") pod "network-check-target-jxvq8" (UID: "9ee48424-7ced-43b6-b473-b6de22e6b53f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 11:51:59.635243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.635213    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-23.ec2.internal" event="NodeReady"
Sep 17 11:51:59.635373 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.635357    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 11:51:59.706855 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.706794    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xvjnx"]
Sep 17 11:51:59.710890 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.710867    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.715593 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.715570    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 11:51:59.715759 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.715571    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 11:51:59.715873 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.715576    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dn4x9\""
Sep 17 11:51:59.745082 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.745058    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7mrjt"]
Sep 17 11:51:59.748040 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.748021    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvjnx"]
Sep 17 11:51:59.748150 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.748121    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:51:59.756894 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.756873    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 11:51:59.756992 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.756900    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fsdq6\""
Sep 17 11:51:59.757162 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.757122    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 11:51:59.757422 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.757405    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 11:51:59.771225 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.771194    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7mrjt"]
Sep 17 11:51:59.887727 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.887696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9q5\" (UniqueName: \"kubernetes.io/projected/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-kube-api-access-5w9q5\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.887727 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.887729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6hbp\" (UniqueName: \"kubernetes.io/projected/8cd40895-ffa6-4b22-9b09-9bce5aaa2adb-kube-api-access-j6hbp\") pod \"ingress-canary-7mrjt\" (UID: \"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb\") " pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:51:59.888141 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.887785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.888141 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.887805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-tmp-dir\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.888141 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.887893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-config-volume\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.888141 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.887925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cd40895-ffa6-4b22-9b09-9bce5aaa2adb-cert\") pod \"ingress-canary-7mrjt\" (UID: \"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb\") " pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:51:59.988587 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.988504    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-tmp-dir\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.988732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.988585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-config-volume\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.988732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.988611    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cd40895-ffa6-4b22-9b09-9bce5aaa2adb-cert\") pod \"ingress-canary-7mrjt\" (UID: \"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb\") " pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:51:59.988732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.988663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9q5\" (UniqueName: \"kubernetes.io/projected/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-kube-api-access-5w9q5\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.988732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.988687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6hbp\" (UniqueName: \"kubernetes.io/projected/8cd40895-ffa6-4b22-9b09-9bce5aaa2adb-kube-api-access-j6hbp\") pod \"ingress-canary-7mrjt\" (UID: \"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb\") " pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:51:59.988732 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.988727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.988983 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.988854    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:51:59.988983 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:51:59.988920    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:52:00.488900459 +0000 UTC m=+35.181347969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:51:59.989272 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.989231    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-tmp-dir\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.989352 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.989334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-config-volume\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:51:59.993465 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:51:59.993440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cd40895-ffa6-4b22-9b09-9bce5aaa2adb-cert\") pod \"ingress-canary-7mrjt\" (UID: \"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb\") " pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:52:00.000515 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.000495    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9q5\" (UniqueName: \"kubernetes.io/projected/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-kube-api-access-5w9q5\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:00.001490 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.001470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6hbp\" (UniqueName: \"kubernetes.io/projected/8cd40895-ffa6-4b22-9b09-9bce5aaa2adb-kube-api-access-j6hbp\") pod \"ingress-canary-7mrjt\" (UID: \"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb\") " pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:52:00.059265 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.059242    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mrjt"
Sep 17 11:52:00.491945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.491907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:00.492114 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:00.492084    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:52:00.492180 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:00.492161    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:52:01.492144586 +0000 UTC m=+36.184592093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:52:00.828183 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.828105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:52:00.828350 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.828106    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:52:00.828350 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.828240    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:52:00.832407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.832112    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4shnp\""
Sep 17 11:52:00.832407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.832133    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdths\""
Sep 17 11:52:00.832407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.832165    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 11:52:00.832407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.832240    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 11:52:00.832407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.832239    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 11:52:00.832407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:00.832371    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 11:52:01.371391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:01.371369    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7mrjt"]
Sep 17 11:52:01.405684 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:01.405658    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd40895_ffa6_4b22_9b09_9bce5aaa2adb.slice/crio-e6947030bcf9733b11181f2bd411f0b187bf2575e0344fff37fa07da937df37c WatchSource:0}: Error finding container e6947030bcf9733b11181f2bd411f0b187bf2575e0344fff37fa07da937df37c: Status 404 returned error can't find the container with id e6947030bcf9733b11181f2bd411f0b187bf2575e0344fff37fa07da937df37c
Sep 17 11:52:01.497486 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:01.497463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:01.497646 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:01.497626    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:52:01.497724 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:01.497704    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:52:03.49768314 +0000 UTC m=+38.190130656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:52:01.995617 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:01.995419    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7mrjt" event={"ID":"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb","Type":"ContainerStarted","Data":"e6947030bcf9733b11181f2bd411f0b187bf2575e0344fff37fa07da937df37c"}
Sep 17 11:52:01.998478 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:01.998452    2571 generic.go:356] "Generic (PLEG): container finished" podID="5aa4570a-8a52-4cb8-b8da-c8313aab0cc1" containerID="19bbe4eb977c50f41d81c9d9f61f64a3c0515c7a9dc3bc3d67d1baa44585dfd8" exitCode=0
Sep 17 11:52:01.998587 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:01.998487    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerDied","Data":"19bbe4eb977c50f41d81c9d9f61f64a3c0515c7a9dc3bc3d67d1baa44585dfd8"}
Sep 17 11:52:03.004242 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:03.004205    2571 generic.go:356] "Generic (PLEG): container finished" podID="5aa4570a-8a52-4cb8-b8da-c8313aab0cc1" containerID="b2984d894c428a5bfa38271223f18b0128de6b3c1b3024fac806b2afda36c65d" exitCode=0
Sep 17 11:52:03.004242 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:03.004245    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerDied","Data":"b2984d894c428a5bfa38271223f18b0128de6b3c1b3024fac806b2afda36c65d"}
Sep 17 11:52:03.513229 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:03.513118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:03.513412 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:03.513261    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:52:03.513412 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:03.513330    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:52:07.513315947 +0000 UTC m=+42.205763455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:52:04.011569 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:04.011537    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" event={"ID":"5aa4570a-8a52-4cb8-b8da-c8313aab0cc1","Type":"ContainerStarted","Data":"fc01a8ee090a89f39df3b037a8c599c52516ac20b1a2001432907394a52b399f"}
Sep 17 11:52:04.037567 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:04.037525    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n4w2c" podStartSLOduration=8.820794041 podStartE2EDuration="39.037506744s" totalImagesPullingTime="30.216712703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:04.036174672 +0000 UTC m=+38.728622215" watchObservedRunningTime="2026-09-17 11:52:04.037506744 +0000 UTC m=+38.729954274"
Sep 17 11:52:05.014980 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:05.014951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7mrjt" event={"ID":"8cd40895-ffa6-4b22-9b09-9bce5aaa2adb","Type":"ContainerStarted","Data":"fbc73b54f4b52cc33e7f7edbe6cfc3e6ada3c0d065f7f177b2273dc734dd45c2"}
Sep 17 11:52:05.032504 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:05.032459    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7mrjt" podStartSLOduration=3.163213311 podStartE2EDuration="6.032441179s" totalImagesPullingTime="2.869227868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:05.03204893 +0000 UTC m=+39.724496462" watchObservedRunningTime="2026-09-17 11:52:05.032441179 +0000 UTC m=+39.724888709"
Sep 17 11:52:07.537685 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:07.537484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:07.538094 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:07.537621    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:52:07.538094 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:07.537814    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:52:15.537797813 +0000 UTC m=+50.230245327 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:52:15.586096 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:15.586055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:15.586551 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:15.586207    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:52:15.586551 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:15.586279    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:52:31.586261836 +0000 UTC m=+66.278709349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:52:21.026407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.026375    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"]
Sep 17 11:52:21.028165 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.028147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.031365 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.031341    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 11:52:21.031365 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.031351    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 11:52:21.031661 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.031644    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 11:52:21.032531 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.032515    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 11:52:21.032664 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.032643    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wn22s\""
Sep 17 11:52:21.041796 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.041757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"]
Sep 17 11:52:21.123181 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.123156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gk6\" (UniqueName: \"kubernetes.io/projected/d1e9d6e2-b146-40c1-8740-26cf574398b5-kube-api-access-46gk6\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.123281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.123186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1e9d6e2-b146-40c1-8740-26cf574398b5-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.123281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.123226    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1e9d6e2-b146-40c1-8740-26cf574398b5-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.134359 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.134336    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-g7q5c"]
Sep 17 11:52:21.136051 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.136037    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.138521 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.138502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 11:52:21.138600 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.138544    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 11:52:21.138748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.138719    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 11:52:21.138911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.138894    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 11:52:21.138991 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.138929    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8zfsb\""
Sep 17 11:52:21.147950 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.147930    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-g7q5c"]
Sep 17 11:52:21.148832 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.148817    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 11:52:21.224373 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2gkl\" (UniqueName: \"kubernetes.io/projected/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-kube-api-access-m2gkl\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.224465 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-snapshots\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.224465 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1e9d6e2-b146-40c1-8740-26cf574398b5-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.224533 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-serving-cert\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.224533 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-service-ca-bundle\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.224618 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224547    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46gk6\" (UniqueName: \"kubernetes.io/projected/d1e9d6e2-b146-40c1-8740-26cf574398b5-kube-api-access-46gk6\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.224618 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1e9d6e2-b146-40c1-8740-26cf574398b5-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.224711 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-trusted-ca-bundle\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.224711 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-tmp\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.224984 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.224968    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1e9d6e2-b146-40c1-8740-26cf574398b5-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.228524 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.228501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1e9d6e2-b146-40c1-8740-26cf574398b5-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.236788 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.236754    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54cb65bf74-dw2wt"]
Sep 17 11:52:21.238615 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.238597    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.239514 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.239445    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"]
Sep 17 11:52:21.239634 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.239440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gk6\" (UniqueName: \"kubernetes.io/projected/d1e9d6e2-b146-40c1-8740-26cf574398b5-kube-api-access-46gk6\") pod \"kube-storage-version-migrator-operator-6c8f84f897-t6wm7\" (UID: \"d1e9d6e2-b146-40c1-8740-26cf574398b5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.241226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.241207    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.241226 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.241222    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jwft5\""
Sep 17 11:52:21.241359 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.241321    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 11:52:21.241543 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.241447    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 11:52:21.242459 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.242405    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 11:52:21.246113 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.246096    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 11:52:21.247273 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.247255    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 11:52:21.247273 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.247271    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 11:52:21.247473 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.247264    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 11:52:21.247566 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.247548    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 11:52:21.247658 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.247625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gfrhs\""
Sep 17 11:52:21.258535 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.258515    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"]
Sep 17 11:52:21.259485 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.259465    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cb65bf74-dw2wt"]
Sep 17 11:52:21.325636 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-trusted-ca\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.325636 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-trusted-ca-bundle\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.325743 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-tmp\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.325743 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325711    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-image-registry-private-configuration\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.325743 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325731    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2gkl\" (UniqueName: \"kubernetes.io/projected/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-kube-api-access-m2gkl\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.325887 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d06b41c-71f1-460c-a682-4b41a241a696-ca-trust-extracted\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.325887 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-installation-pull-secrets\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.325887 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52hmj\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-kube-api-access-52hmj\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.325887 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-snapshots\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.326073 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-bound-sa-token\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.326073 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325912    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxzsx\" (UniqueName: \"kubernetes.io/projected/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-kube-api-access-cxzsx\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.326073 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.325931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-serving-cert\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.326073 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-serving-cert\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.326073 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326056    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.326309 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-registry-certificates\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.326309 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-tmp\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.326309 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-service-ca-bundle\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.326309 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326182    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-config\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.326506 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326365    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-snapshots\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.326568 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326555    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-trusted-ca-bundle\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.326665 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.326647    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-service-ca-bundle\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.328280 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.328263    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-serving-cert\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.334530 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.334509    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2gkl\" (UniqueName: \"kubernetes.io/projected/4f2f6688-39b7-4147-bd59-c824eb0cd0bc-kube-api-access-m2gkl\") pod \"insights-operator-5844b856db-g7q5c\" (UID: \"4f2f6688-39b7-4147-bd59-c824eb0cd0bc\") " pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.343337 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.343323    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"
Sep 17 11:52:21.427438 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427411    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-config\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.427553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-trusted-ca\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-image-registry-private-configuration\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d06b41c-71f1-460c-a682-4b41a241a696-ca-trust-extracted\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-installation-pull-secrets\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52hmj\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-kube-api-access-52hmj\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427828 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-bound-sa-token\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427828 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxzsx\" (UniqueName: \"kubernetes.io/projected/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-kube-api-access-cxzsx\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.427828 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-serving-cert\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.427828 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.427828 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-registry-certificates\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.428118 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.427980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d06b41c-71f1-460c-a682-4b41a241a696-ca-trust-extracted\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.428118 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.428062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-config\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.428118 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:21.428089    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 11:52:21.428118 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:21.428103    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cb65bf74-dw2wt: secret "image-registry-tls" not found
Sep 17 11:52:21.428326 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:21.428176    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls podName:0d06b41c-71f1-460c-a682-4b41a241a696 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:21.928157368 +0000 UTC m=+56.620604898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls") pod "image-registry-54cb65bf74-dw2wt" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696") : secret "image-registry-tls" not found
Sep 17 11:52:21.428575 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.428554    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-registry-certificates\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.429313 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.429288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-trusted-ca\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.430105 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.430078    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-installation-pull-secrets\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.430205 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.430177    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-image-registry-private-configuration\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.430359 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.430340    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-serving-cert\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.436489 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.436466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52hmj\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-kube-api-access-52hmj\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.436641 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.436618    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-bound-sa-token\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.436698 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.436624    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxzsx\" (UniqueName: \"kubernetes.io/projected/fdddb6e7-7c33-48e4-858c-8d14ac25e2f3-kube-api-access-cxzsx\") pod \"service-ca-operator-cf7c776b7-9pd7h\" (UID: \"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.444534 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.444519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-g7q5c"
Sep 17 11:52:21.559848 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.559823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"
Sep 17 11:52:21.614704 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.614651    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7"]
Sep 17 11:52:21.617322 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:21.617298    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e9d6e2_b146_40c1_8740_26cf574398b5.slice/crio-4d3885d2820406c616cfa40061cb7eba2c3abebfacc7809be200c9a5339469d7 WatchSource:0}: Error finding container 4d3885d2820406c616cfa40061cb7eba2c3abebfacc7809be200c9a5339469d7: Status 404 returned error can't find the container with id 4d3885d2820406c616cfa40061cb7eba2c3abebfacc7809be200c9a5339469d7
Sep 17 11:52:21.712573 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.712555    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-g7q5c"]
Sep 17 11:52:21.714479 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:21.714454    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2f6688_39b7_4147_bd59_c824eb0cd0bc.slice/crio-9bc0bbe1e05aaf77fd33de85f6bb7984984b6a36fc2a81e9b1bb07f0974420d5 WatchSource:0}: Error finding container 9bc0bbe1e05aaf77fd33de85f6bb7984984b6a36fc2a81e9b1bb07f0974420d5: Status 404 returned error can't find the container with id 9bc0bbe1e05aaf77fd33de85f6bb7984984b6a36fc2a81e9b1bb07f0974420d5
Sep 17 11:52:21.832287 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.832267    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h"]
Sep 17 11:52:21.834519 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:21.834501    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdddb6e7_7c33_48e4_858c_8d14ac25e2f3.slice/crio-14550738d2ef70b17fe6147a1b51f55532568e25f86d3836de64813900753987 WatchSource:0}: Error finding container 14550738d2ef70b17fe6147a1b51f55532568e25f86d3836de64813900753987: Status 404 returned error can't find the container with id 14550738d2ef70b17fe6147a1b51f55532568e25f86d3836de64813900753987
Sep 17 11:52:21.930548 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:21.930497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:21.930628 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:21.930611    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 11:52:21.930628 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:21.930621    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cb65bf74-dw2wt: secret "image-registry-tls" not found
Sep 17 11:52:21.930691 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:21.930662    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls podName:0d06b41c-71f1-460c-a682-4b41a241a696 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:22.930650429 +0000 UTC m=+57.623097941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls") pod "image-registry-54cb65bf74-dw2wt" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696") : secret "image-registry-tls" not found
Sep 17 11:52:22.054678 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:22.054650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h" event={"ID":"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3","Type":"ContainerStarted","Data":"14550738d2ef70b17fe6147a1b51f55532568e25f86d3836de64813900753987"}
Sep 17 11:52:22.055889 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:22.055865    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7" event={"ID":"d1e9d6e2-b146-40c1-8740-26cf574398b5","Type":"ContainerStarted","Data":"4d3885d2820406c616cfa40061cb7eba2c3abebfacc7809be200c9a5339469d7"}
Sep 17 11:52:22.057009 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:22.056992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g7q5c" event={"ID":"4f2f6688-39b7-4147-bd59-c824eb0cd0bc","Type":"ContainerStarted","Data":"9bc0bbe1e05aaf77fd33de85f6bb7984984b6a36fc2a81e9b1bb07f0974420d5"}
Sep 17 11:52:22.937995 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:22.937964    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:22.938156 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:22.938123    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 11:52:22.938156 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:22.938142    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cb65bf74-dw2wt: secret "image-registry-tls" not found
Sep 17 11:52:22.938232 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:22.938198    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls podName:0d06b41c-71f1-460c-a682-4b41a241a696 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:24.938182269 +0000 UTC m=+59.630629799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls") pod "image-registry-54cb65bf74-dw2wt" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696") : secret "image-registry-tls" not found
Sep 17 11:52:24.955653 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:24.955623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:24.956032 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:24.955806    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 11:52:24.956032 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:24.955826    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cb65bf74-dw2wt: secret "image-registry-tls" not found
Sep 17 11:52:24.956032 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:24.955882    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls podName:0d06b41c-71f1-460c-a682-4b41a241a696 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:28.955867411 +0000 UTC m=+63.648314924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls") pod "image-registry-54cb65bf74-dw2wt" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696") : secret "image-registry-tls" not found
Sep 17 11:52:26.069292 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.069253    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h" event={"ID":"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3","Type":"ContainerStarted","Data":"db60d74428687b885b5f8ea9911c8b97bf3663b86bb0586a8a4e62cb80888bad"}
Sep 17 11:52:26.070963 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.070928    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7" event={"ID":"d1e9d6e2-b146-40c1-8740-26cf574398b5","Type":"ContainerStarted","Data":"ec9eeebeb4efd7a8ac4db2ef19cd4b26e84eed1c25a470de9eb71fec50f695c2"}
Sep 17 11:52:26.072580 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.072553    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g7q5c" event={"ID":"4f2f6688-39b7-4147-bd59-c824eb0cd0bc","Type":"ContainerStarted","Data":"433275c5a1e5163cc09ab6da2ff06ec8df240073533011aedf5abbf6b0bcbdbc"}
Sep 17 11:52:26.089243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.089182    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h" podStartSLOduration=1.670837651 podStartE2EDuration="5.089162868s" totalImagesPullingTime="3.418325217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:26.087849051 +0000 UTC m=+60.780296580" watchObservedRunningTime="2026-09-17 11:52:26.089162868 +0000 UTC m=+60.781610399"
Sep 17 11:52:26.107369 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.107330    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-g7q5c" podStartSLOduration=1.5755369479999999 podStartE2EDuration="5.107316394s" totalImagesPullingTime="3.531779446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:26.106686009 +0000 UTC m=+60.799133539" watchObservedRunningTime="2026-09-17 11:52:26.107316394 +0000 UTC m=+60.799763921"
Sep 17 11:52:26.128053 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.128009    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7" podStartSLOduration=1.499030722 podStartE2EDuration="5.12799693s" totalImagesPullingTime="3.628966208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:26.127275445 +0000 UTC m=+60.819722974" watchObservedRunningTime="2026-09-17 11:52:26.12799693 +0000 UTC m=+60.820444459"
Sep 17 11:52:26.992345 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:26.992316    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9kddg"
Sep 17 11:52:27.031568 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.031545    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"]
Sep 17 11:52:27.034439 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.034415    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"
Sep 17 11:52:27.037967 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.037946    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 11:52:27.038102 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.038004    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 11:52:27.038102 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.038004    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-p9cpn\""
Sep 17 11:52:27.052925 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.052906    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"]
Sep 17 11:52:27.072136 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.072114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjt82\" (UniqueName: \"kubernetes.io/projected/1afb88ea-16fc-4ae1-a800-81eaf4e4f52a-kube-api-access-wjt82\") pod \"migrator-8b4d697c5-vgdcw\" (UID: \"1afb88ea-16fc-4ae1-a800-81eaf4e4f52a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"
Sep 17 11:52:27.173686 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.173661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjt82\" (UniqueName: \"kubernetes.io/projected/1afb88ea-16fc-4ae1-a800-81eaf4e4f52a-kube-api-access-wjt82\") pod \"migrator-8b4d697c5-vgdcw\" (UID: \"1afb88ea-16fc-4ae1-a800-81eaf4e4f52a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"
Sep 17 11:52:27.186689 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.186671    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjt82\" (UniqueName: \"kubernetes.io/projected/1afb88ea-16fc-4ae1-a800-81eaf4e4f52a-kube-api-access-wjt82\") pod \"migrator-8b4d697c5-vgdcw\" (UID: \"1afb88ea-16fc-4ae1-a800-81eaf4e4f52a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"
Sep 17 11:52:27.343673 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.343618    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"
Sep 17 11:52:27.499351 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.499320    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xcptd"]
Sep 17 11:52:27.501399 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.501384    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.503862 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.503838    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w85wt\""
Sep 17 11:52:27.503862 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.503862    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 11:52:27.504218 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.504199    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 11:52:27.516749 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.516729    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xcptd"]
Sep 17 11:52:27.577082 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.577057    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-data-volume\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.577176 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.577122    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.577176 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.577157    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.577255 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.577187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-crio-socket\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.577255 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.577210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85l4s\" (UniqueName: \"kubernetes.io/projected/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-api-access-85l4s\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.617641 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.617587    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw"]
Sep 17 11:52:27.620547 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:27.620525    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afb88ea_16fc_4ae1_a800_81eaf4e4f52a.slice/crio-405b0ca59de6e29919ca34179e7bc5fd21d333dfb13b4ca443a38922d6e9e3d3 WatchSource:0}: Error finding container 405b0ca59de6e29919ca34179e7bc5fd21d333dfb13b4ca443a38922d6e9e3d3: Status 404 returned error can't find the container with id 405b0ca59de6e29919ca34179e7bc5fd21d333dfb13b4ca443a38922d6e9e3d3
Sep 17 11:52:27.677697 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.677674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-data-volume\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.677812 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.677727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.677812 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.677785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.677930 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:27.677866    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 11:52:27.677930 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:27.677917    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:27.678030 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.677923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-crio-socket\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.678030 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:27.677924    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:28.177911839 +0000 UTC m=+62.870359350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : configmap "kube-rbac-proxy" not found
Sep 17 11:52:27.678030 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.677973    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-crio-socket\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.678030 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.677989    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-data-volume\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.678030 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:27.678011    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:28.177992297 +0000 UTC m=+62.870439819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:27.678233 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.678033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l4s\" (UniqueName: \"kubernetes.io/projected/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-api-access-85l4s\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:27.687923 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:27.687902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85l4s\" (UniqueName: \"kubernetes.io/projected/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-api-access-85l4s\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:28.077839 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:28.077810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw" event={"ID":"1afb88ea-16fc-4ae1-a800-81eaf4e4f52a","Type":"ContainerStarted","Data":"405b0ca59de6e29919ca34179e7bc5fd21d333dfb13b4ca443a38922d6e9e3d3"}
Sep 17 11:52:28.182024 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:28.181994    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:28.182139 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:28.182057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:28.182214 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.182153    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 11:52:28.182214 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.182155    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:28.182214 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.182200    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:29.182188216 +0000 UTC m=+63.874635723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : configmap "kube-rbac-proxy" not found
Sep 17 11:52:28.182349 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.182224    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:29.182206789 +0000 UTC m=+63.874654314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:28.988598 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:28.988567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:28.988710 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.988688    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 11:52:28.988710 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.988700    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54cb65bf74-dw2wt: secret "image-registry-tls" not found
Sep 17 11:52:28.988800 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:28.988749    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls podName:0d06b41c-71f1-460c-a682-4b41a241a696 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:36.98873176 +0000 UTC m=+71.681179276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls") pod "image-registry-54cb65bf74-dw2wt" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696") : secret "image-registry-tls" not found
Sep 17 11:52:29.079618 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.079590    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-2vtrc"]
Sep 17 11:52:29.082811 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.082791    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.086324 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.086300    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw" event={"ID":"1afb88ea-16fc-4ae1-a800-81eaf4e4f52a","Type":"ContainerStarted","Data":"5d088ace1ad65cef1d02c2f778f2739b4cbdeb157655b99177cf12e50800f2a4"}
Sep 17 11:52:29.086444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.086339    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw" event={"ID":"1afb88ea-16fc-4ae1-a800-81eaf4e4f52a","Type":"ContainerStarted","Data":"97d4f1e4e792aa4232e890e8bb182526066786cfb22531634f35929ddbaf4772"}
Sep 17 11:52:29.086444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.086383    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 11:52:29.086554 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.086493    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 11:52:29.087474 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.087456    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 11:52:29.087634 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.087616    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kf565\""
Sep 17 11:52:29.087730 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.087711    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 11:52:29.093091 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.093073    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-2vtrc"]
Sep 17 11:52:29.135110 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.135059    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vgdcw" podStartSLOduration=2.080048935 podStartE2EDuration="3.135046722s" totalImagesPullingTime="1.054997787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:29.133329078 +0000 UTC m=+63.825776607" watchObservedRunningTime="2026-09-17 11:52:29.135046722 +0000 UTC m=+63.827494251"
Sep 17 11:52:29.190090 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.190065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:29.190180 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.190103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/531db1a6-ad76-4aff-9f85-7eff41392d74-signing-cabundle\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.190228 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:29.190195    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:29.190228 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.190208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:29.190322 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:29.190243    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:31.190230713 +0000 UTC m=+65.882678223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:29.190322 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.190269    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrhp\" (UniqueName: \"kubernetes.io/projected/531db1a6-ad76-4aff-9f85-7eff41392d74-kube-api-access-bhrhp\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.190427 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.190326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/531db1a6-ad76-4aff-9f85-7eff41392d74-signing-key\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.190427 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:29.190334    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 11:52:29.190427 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:29.190411    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:31.190392518 +0000 UTC m=+65.882840051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : configmap "kube-rbac-proxy" not found
Sep 17 11:52:29.290860 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.290806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrhp\" (UniqueName: \"kubernetes.io/projected/531db1a6-ad76-4aff-9f85-7eff41392d74-kube-api-access-bhrhp\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.290945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.290862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/531db1a6-ad76-4aff-9f85-7eff41392d74-signing-key\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.290945 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.290896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/531db1a6-ad76-4aff-9f85-7eff41392d74-signing-cabundle\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.291431 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.291402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/531db1a6-ad76-4aff-9f85-7eff41392d74-signing-cabundle\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.293441 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.293418    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/531db1a6-ad76-4aff-9f85-7eff41392d74-signing-key\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.304882 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.304861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrhp\" (UniqueName: \"kubernetes.io/projected/531db1a6-ad76-4aff-9f85-7eff41392d74-kube-api-access-bhrhp\") pod \"service-ca-568869fdc5-2vtrc\" (UID: \"531db1a6-ad76-4aff-9f85-7eff41392d74\") " pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.392935 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.392913    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-2vtrc"
Sep 17 11:52:29.678475 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:29.678096    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-2vtrc"]
Sep 17 11:52:29.682309 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:29.682285    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531db1a6_ad76_4aff_9f85_7eff41392d74.slice/crio-9b71b9d3be65241cf1276c128aec137d863346fc475822c70cd460a8571720ad WatchSource:0}: Error finding container 9b71b9d3be65241cf1276c128aec137d863346fc475822c70cd460a8571720ad: Status 404 returned error can't find the container with id 9b71b9d3be65241cf1276c128aec137d863346fc475822c70cd460a8571720ad
Sep 17 11:52:30.091785 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:30.091738    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-2vtrc" event={"ID":"531db1a6-ad76-4aff-9f85-7eff41392d74","Type":"ContainerStarted","Data":"2ec1cdf997c2a9b8ffb3084ac75e9717cec596e2818e08086df9769f486ddc33"}
Sep 17 11:52:30.092204 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:30.091807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-2vtrc" event={"ID":"531db1a6-ad76-4aff-9f85-7eff41392d74","Type":"ContainerStarted","Data":"9b71b9d3be65241cf1276c128aec137d863346fc475822c70cd460a8571720ad"}
Sep 17 11:52:30.119984 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:30.119941    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-2vtrc" podStartSLOduration=1.119925781 podStartE2EDuration="1.119925781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:30.119465069 +0000 UTC m=+64.811912622" watchObservedRunningTime="2026-09-17 11:52:30.119925781 +0000 UTC m=+64.812373313"
Sep 17 11:52:30.239746 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:30.239727    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tbqrr_a0295d97-4c7e-4d87-864c-ff949309f483/dns-node-resolver/0.log"
Sep 17 11:52:31.043685 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.043658    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vxzb_cdc9e219-6385-4468-a438-8ee1c63bde48/node-ca/0.log"
Sep 17 11:52:31.207762 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.207732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:31.208215 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.207865    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 11:52:31.208215 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.207921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:31.208215 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.207932    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:35.207913901 +0000 UTC m=+69.900361423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : configmap "kube-rbac-proxy" not found
Sep 17 11:52:31.208347 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.208280    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:31.208347 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.208340    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:35.208324776 +0000 UTC m=+69.900772288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:31.611557 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.611530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:52:31.611699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.611589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:52:31.611699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.611643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:52:31.611699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.611670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:52:31.611699 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.611680    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 11:52:31.611905 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.611740    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls podName:d5b6bbbd-5113-4e38-9a9d-193c7b39306a nodeName:}" failed. No retries permitted until 2026-09-17 11:53:03.611722313 +0000 UTC m=+98.304169836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls") pod "dns-default-xvjnx" (UID: "d5b6bbbd-5113-4e38-9a9d-193c7b39306a") : secret "dns-default-metrics-tls" not found
Sep 17 11:52:31.616045 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.616025    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 11:52:31.616157 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.616067    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 11:52:31.617864 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.617843    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 11:52:31.622115 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.622097    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 11:52:31.622218 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:31.622150    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs podName:ab3f4936-192b-45e9-bf37-03bc8928f2fa nodeName:}" failed. No retries permitted until 2026-09-17 11:53:35.622135235 +0000 UTC m=+130.314582742 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs") pod "network-metrics-daemon-2hdbd" (UID: "ab3f4936-192b-45e9-bf37-03bc8928f2fa") : secret "metrics-daemon-secret" not found
Sep 17 11:52:31.625890 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.625870    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 11:52:31.626012 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.625992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c979f41e-7d67-4120-be8f-ab41e67cfc71-original-pull-secret\") pod \"global-pull-secret-syncer-n7lj9\" (UID: \"c979f41e-7d67-4120-be8f-ab41e67cfc71\") " pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:52:31.635607 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.635584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx68v\" (UniqueName: \"kubernetes.io/projected/9ee48424-7ced-43b6-b473-b6de22e6b53f-kube-api-access-vx68v\") pod \"network-check-target-jxvq8\" (UID: \"9ee48424-7ced-43b6-b473-b6de22e6b53f\") " pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:52:31.743262 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.743229    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4shnp\""
Sep 17 11:52:31.750452 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.750426    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:52:31.752731 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:31.752713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7lj9"
Sep 17 11:52:32.039613 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.039590    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7mrjt_8cd40895-ffa6-4b22-9b09-9bce5aaa2adb/serve-healthcheck-canary/0.log"
Sep 17 11:52:32.049716 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.049692    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxvq8"]
Sep 17 11:52:32.052232 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:32.052211    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee48424_7ced_43b6_b473_b6de22e6b53f.slice/crio-689cb245c125e5d6096a16c52993edb3d9f9622f302d94392c32655686c3a52e WatchSource:0}: Error finding container 689cb245c125e5d6096a16c52993edb3d9f9622f302d94392c32655686c3a52e: Status 404 returned error can't find the container with id 689cb245c125e5d6096a16c52993edb3d9f9622f302d94392c32655686c3a52e
Sep 17 11:52:32.076551 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.076533    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7lj9"]
Sep 17 11:52:32.079121 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:32.079096    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc979f41e_7d67_4120_be8f_ab41e67cfc71.slice/crio-3bf7f8cc99326b983996dcc7867f8fb3175e09204e11e6dab78ca4490f17cb4b WatchSource:0}: Error finding container 3bf7f8cc99326b983996dcc7867f8fb3175e09204e11e6dab78ca4490f17cb4b: Status 404 returned error can't find the container with id 3bf7f8cc99326b983996dcc7867f8fb3175e09204e11e6dab78ca4490f17cb4b
Sep 17 11:52:32.100062 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.100038    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxvq8" event={"ID":"9ee48424-7ced-43b6-b473-b6de22e6b53f","Type":"ContainerStarted","Data":"689cb245c125e5d6096a16c52993edb3d9f9622f302d94392c32655686c3a52e"}
Sep 17 11:52:32.101158 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.101139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7lj9" event={"ID":"c979f41e-7d67-4120-be8f-ab41e67cfc71","Type":"ContainerStarted","Data":"3bf7f8cc99326b983996dcc7867f8fb3175e09204e11e6dab78ca4490f17cb4b"}
Sep 17 11:52:32.442088 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.442022    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vgdcw_1afb88ea-16fc-4ae1-a800-81eaf4e4f52a/migrator/0.log"
Sep 17 11:52:32.640179 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.640148    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vgdcw_1afb88ea-16fc-4ae1-a800-81eaf4e4f52a/graceful-termination/0.log"
Sep 17 11:52:32.850859 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:32.850830    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-t6wm7_d1e9d6e2-b146-40c1-8740-26cf574398b5/kube-storage-version-migrator-operator/0.log"
Sep 17 11:52:35.244802 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:35.244751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:35.245198 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:35.244848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:35.245198 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:35.244893    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:35.245198 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:35.244950    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:43.244935166 +0000 UTC m=+77.937382690 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : secret "insights-runtime-extractor-tls" not found
Sep 17 11:52:35.245198 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:35.244980    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 11:52:35.245198 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:52:35.245032    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm podName:af079eaa-0d41-4cf8-9e3c-6bdac91bbc87 nodeName:}" failed. No retries permitted until 2026-09-17 11:52:43.245017197 +0000 UTC m=+77.937464721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xcptd" (UID: "af079eaa-0d41-4cf8-9e3c-6bdac91bbc87") : configmap "kube-rbac-proxy" not found
Sep 17 11:52:37.060289 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.060266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:37.062560 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.062535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"image-registry-54cb65bf74-dw2wt\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") " pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:37.123133 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.123105    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7lj9" event={"ID":"c979f41e-7d67-4120-be8f-ab41e67cfc71","Type":"ContainerStarted","Data":"2d013a06adc9e56c538650820752c132d41c550b9c3030ae32f450167436f573"}
Sep 17 11:52:37.124860 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.124836    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxvq8" event={"ID":"9ee48424-7ced-43b6-b473-b6de22e6b53f","Type":"ContainerStarted","Data":"8ff824a61340ee83dcbcbfdd7c3a37364cfe1a9acf84c24cf9918037c65e76b6"}
Sep 17 11:52:37.124980 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.124960    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:52:37.149580 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.149533    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n7lj9" podStartSLOduration=66.276697751 podStartE2EDuration="1m11.149516247s" totalImagesPullingTime="4.872818496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:51:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:37.149477787 +0000 UTC m=+71.841925318" watchObservedRunningTime="2026-09-17 11:52:37.149516247 +0000 UTC m=+71.841963778"
Sep 17 11:52:37.156928 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.156905    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jwft5\""
Sep 17 11:52:37.164198 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.164181    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:37.173712 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.173665    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jxvq8" podStartSLOduration=67.277953506 podStartE2EDuration="1m12.173646786s" totalImagesPullingTime="4.89569328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:37.170811268 +0000 UTC m=+71.863258794" watchObservedRunningTime="2026-09-17 11:52:37.173646786 +0000 UTC m=+71.866094317"
Sep 17 11:52:37.442887 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:37.442859    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54cb65bf74-dw2wt"]
Sep 17 11:52:37.445984 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:37.445955    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d06b41c_71f1_460c_a682_4b41a241a696.slice/crio-03c9b42443d8315248abf0b5f24043ac967636b496eb67996014632c4fbbd1c7 WatchSource:0}: Error finding container 03c9b42443d8315248abf0b5f24043ac967636b496eb67996014632c4fbbd1c7: Status 404 returned error can't find the container with id 03c9b42443d8315248abf0b5f24043ac967636b496eb67996014632c4fbbd1c7
Sep 17 11:52:38.129926 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:38.129888    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" event={"ID":"0d06b41c-71f1-460c-a682-4b41a241a696","Type":"ContainerStarted","Data":"41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8"}
Sep 17 11:52:38.130299 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:38.130104    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:52:38.130299 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:38.130147    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" event={"ID":"0d06b41c-71f1-460c-a682-4b41a241a696","Type":"ContainerStarted","Data":"03c9b42443d8315248abf0b5f24043ac967636b496eb67996014632c4fbbd1c7"}
Sep 17 11:52:38.168936 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:38.168894    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" podStartSLOduration=17.168880214 podStartE2EDuration="17.168880214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:38.167910845 +0000 UTC m=+72.860358377" watchObservedRunningTime="2026-09-17 11:52:38.168880214 +0000 UTC m=+72.861327743"
Sep 17 11:52:43.307426 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:43.307390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:43.307917 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:43.307440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:43.307971 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:43.307935    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:43.310025 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:43.309999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af079eaa-0d41-4cf8-9e3c-6bdac91bbc87-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcptd\" (UID: \"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87\") " pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:43.411032 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:43.411006    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xcptd"
Sep 17 11:52:43.700978 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:43.700953    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xcptd"]
Sep 17 11:52:43.703905 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:43.703881    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf079eaa_0d41_4cf8_9e3c_6bdac91bbc87.slice/crio-096fba8bbecc7af066c3a1f740e3eefdeffc33745418db4f1baafc4d1236695e WatchSource:0}: Error finding container 096fba8bbecc7af066c3a1f740e3eefdeffc33745418db4f1baafc4d1236695e: Status 404 returned error can't find the container with id 096fba8bbecc7af066c3a1f740e3eefdeffc33745418db4f1baafc4d1236695e
Sep 17 11:52:44.158060 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:44.157983    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcptd" event={"ID":"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87","Type":"ContainerStarted","Data":"f1db55b0759d99634ebf3d8e8be1951915af6470d7bee75032783ea9b6833a3b"}
Sep 17 11:52:44.158060 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:44.158036    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcptd" event={"ID":"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87","Type":"ContainerStarted","Data":"096fba8bbecc7af066c3a1f740e3eefdeffc33745418db4f1baafc4d1236695e"}
Sep 17 11:52:45.165610 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:45.165576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcptd" event={"ID":"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87","Type":"ContainerStarted","Data":"23b8bffb0c30e50c2b1d485dc3b8e8da6741cc58635cc34089406b04af0d404a"}
Sep 17 11:52:46.175483 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:46.175400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcptd" event={"ID":"af079eaa-0d41-4cf8-9e3c-6bdac91bbc87","Type":"ContainerStarted","Data":"bbb6aadb0e38a18783904781d8b9fb8fc84e45bed26f31d5e7914bc75659b10e"}
Sep 17 11:52:46.198440 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:46.198389    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xcptd" podStartSLOduration=17.142976629 podStartE2EDuration="19.198374213s" totalImagesPullingTime="2.055397584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:52:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:46.196345325 +0000 UTC m=+80.888792857" watchObservedRunningTime="2026-09-17 11:52:46.198374213 +0000 UTC m=+80.890821743"
Sep 17 11:52:56.208707 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.208677    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"]
Sep 17 11:52:56.211988 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.211968    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.214351 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.214326    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rpg6d\""
Sep 17 11:52:56.215195 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.215176    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 11:52:56.215266 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.215232    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 11:52:56.225317 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.225287    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"]
Sep 17 11:52:56.270262 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.270237    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cb65bf74-dw2wt"]
Sep 17 11:52:56.274357 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.274335    2571 patch_prober.go:28] interesting pod/image-registry-54cb65bf74-dw2wt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 11:52:56.274447 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.274382    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" podUID="0d06b41c-71f1-460c-a682-4b41a241a696" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 11:52:56.295158 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.295140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c243b463-b1c4-4af9-bc95-ce6e3f9f93f9-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-nrghd\" (UID: \"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.295249 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.295172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c243b463-b1c4-4af9-bc95-ce6e3f9f93f9-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-nrghd\" (UID: \"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.395736 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.395707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c243b463-b1c4-4af9-bc95-ce6e3f9f93f9-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-nrghd\" (UID: \"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.395867 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.395741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c243b463-b1c4-4af9-bc95-ce6e3f9f93f9-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-nrghd\" (UID: \"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.396351 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.396328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c243b463-b1c4-4af9-bc95-ce6e3f9f93f9-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-nrghd\" (UID: \"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.398233 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.398205    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c243b463-b1c4-4af9-bc95-ce6e3f9f93f9-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-nrghd\" (UID: \"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.414361 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.414334    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78c8895ff4-htrmk"]
Sep 17 11:52:56.416329 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.416312    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.432641 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.432620    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78c8895ff4-htrmk"]
Sep 17 11:52:56.496576 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-trusted-ca\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496576 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-registry-certificates\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496606    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-image-registry-private-configuration\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjqln\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-kube-api-access-qjqln\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-registry-tls\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-installation-pull-secrets\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-ca-trust-extracted\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.496962 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.496739    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-bound-sa-token\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.521531 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.521513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"
Sep 17 11:52:56.597279 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-trusted-ca\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597377 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-registry-certificates\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597377 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-image-registry-private-configuration\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597377 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjqln\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-kube-api-access-qjqln\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597377 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-registry-tls\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597582 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-installation-pull-secrets\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597582 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-ca-trust-extracted\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.597582 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.597546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-bound-sa-token\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.598237 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.598217    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-registry-certificates\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.598357 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.598249    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-ca-trust-extracted\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.598547 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.598523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-trusted-ca\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.599823 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.599805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-registry-tls\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.600013 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.599996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-installation-pull-secrets\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.600291 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.600275    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-image-registry-private-configuration\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.622669 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.622646    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-bound-sa-token\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.622754 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.622701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjqln\" (UniqueName: \"kubernetes.io/projected/cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9-kube-api-access-qjqln\") pod \"image-registry-78c8895ff4-htrmk\" (UID: \"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9\") " pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.724417 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.724397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:56.808391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:56.808369    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd"]
Sep 17 11:52:56.809514 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:56.809492    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc243b463_b1c4_4af9_bc95_ce6e3f9f93f9.slice/crio-e2f3437ff66fff3d8ca56db68f4a05a972e3255e3c8860bd477475e859a0431c WatchSource:0}: Error finding container e2f3437ff66fff3d8ca56db68f4a05a972e3255e3c8860bd477475e859a0431c: Status 404 returned error can't find the container with id e2f3437ff66fff3d8ca56db68f4a05a972e3255e3c8860bd477475e859a0431c
Sep 17 11:52:57.015546 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:57.015511    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78c8895ff4-htrmk"]
Sep 17 11:52:57.020167 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:52:57.020117    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc4eb549_9a8b_4a51_8696_5c51d8dcc4b9.slice/crio-fd5d587fa493685e0dc27bf31ec4293da6fa40d813a6bc66f47c3482512e01a9 WatchSource:0}: Error finding container fd5d587fa493685e0dc27bf31ec4293da6fa40d813a6bc66f47c3482512e01a9: Status 404 returned error can't find the container with id fd5d587fa493685e0dc27bf31ec4293da6fa40d813a6bc66f47c3482512e01a9
Sep 17 11:52:57.219435 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:57.219402    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk" event={"ID":"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9","Type":"ContainerStarted","Data":"d2edf59c4399d87fa2e61fe75116300ec7d7f1a83548b634c372488f29c45928"}
Sep 17 11:52:57.219889 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:57.219462    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk" event={"ID":"cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9","Type":"ContainerStarted","Data":"fd5d587fa493685e0dc27bf31ec4293da6fa40d813a6bc66f47c3482512e01a9"}
Sep 17 11:52:57.219889 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:57.219488    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:52:57.220809 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:57.220787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd" event={"ID":"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9","Type":"ContainerStarted","Data":"e2f3437ff66fff3d8ca56db68f4a05a972e3255e3c8860bd477475e859a0431c"}
Sep 17 11:52:58.225581 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:58.225480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd" event={"ID":"c243b463-b1c4-4af9-bc95-ce6e3f9f93f9","Type":"ContainerStarted","Data":"01e5c343700fa4bfb6aaefe6d0efa2119f49c5e08d7fbcbe1e5c10b2748a5d12"}
Sep 17 11:52:58.241950 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:58.241904    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk" podStartSLOduration=2.241889179 podStartE2EDuration="2.241889179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:57.244927203 +0000 UTC m=+91.937374744" watchObservedRunningTime="2026-09-17 11:52:58.241889179 +0000 UTC m=+92.934336705"
Sep 17 11:52:58.242909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:52:58.242877    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-nrghd" podStartSLOduration=1.102276597 podStartE2EDuration="2.242864037s" totalImagesPullingTime="1.14058744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:52:58.242074571 +0000 UTC m=+92.934522103" watchObservedRunningTime="2026-09-17 11:52:58.242864037 +0000 UTC m=+92.935311568"
Sep 17 11:53:03.645756 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:03.645718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:53:03.648340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:03.648319    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d5b6bbbd-5113-4e38-9a9d-193c7b39306a-metrics-tls\") pod \"dns-default-xvjnx\" (UID: \"d5b6bbbd-5113-4e38-9a9d-193c7b39306a\") " pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:53:03.924098 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:03.924022    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dn4x9\""
Sep 17 11:53:03.932280 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:03.932253    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:53:04.211299 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.211273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xvjnx"]
Sep 17 11:53:04.215053 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:04.215029    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b6bbbd_5113_4e38_9a9d_193c7b39306a.slice/crio-818629fe783ce52fbed67a5b949ebeaec94e1ee303dae5213c9be61cccfab875 WatchSource:0}: Error finding container 818629fe783ce52fbed67a5b949ebeaec94e1ee303dae5213c9be61cccfab875: Status 404 returned error can't find the container with id 818629fe783ce52fbed67a5b949ebeaec94e1ee303dae5213c9be61cccfab875
Sep 17 11:53:04.218101 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.217745    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"]
Sep 17 11:53:04.222682 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.222662    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.226456 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.226418    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 11:53:04.227911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.227443    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8j9tp\""
Sep 17 11:53:04.227911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.227502    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 11:53:04.227911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.227641    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 11:53:04.227911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.227714    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 11:53:04.227911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.227445    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 11:53:04.238291 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.238273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"]
Sep 17 11:53:04.247145 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.247119    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvjnx" event={"ID":"d5b6bbbd-5113-4e38-9a9d-193c7b39306a","Type":"ContainerStarted","Data":"818629fe783ce52fbed67a5b949ebeaec94e1ee303dae5213c9be61cccfab875"}
Sep 17 11:53:04.285577 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.285553    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mmmzx"]
Sep 17 11:53:04.289189 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.289173    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.293124 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.293105    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dr9q4\""
Sep 17 11:53:04.293216 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.293132    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 11:53:04.293567 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.293552    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 11:53:04.293704 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.293621    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 11:53:04.350343 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.350320    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.350499 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.350353    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e5fade-967a-4237-8d81-2ed4a986b8a3-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.350499 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.350393    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzv55\" (UniqueName: \"kubernetes.io/projected/17e5fade-967a-4237-8d81-2ed4a986b8a3-kube-api-access-kzv55\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.350499 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.350435    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.451311 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451457 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451328    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms7gc\" (UniqueName: \"kubernetes.io/projected/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-kube-api-access-ms7gc\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451457 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451406    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-root\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451581 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451453    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-metrics-client-ca\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451581 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-sys\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451581 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451520    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.451581 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-tls\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451579    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e5fade-967a-4237-8d81-2ed4a986b8a3-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451616    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-textfile\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:53:04.451663    2571 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzv55\" (UniqueName: \"kubernetes.io/projected/17e5fade-967a-4237-8d81-2ed4a986b8a3-kube-api-access-kzv55\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:53:04.451730    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-tls podName:17e5fade-967a-4237-8d81-2ed4a986b8a3 nodeName:}" failed. No retries permitted until 2026-09-17 11:53:04.951709825 +0000 UTC m=+99.644157338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-gjp7k" (UID: "17e5fade-967a-4237-8d81-2ed4a986b8a3") : secret "openshift-state-metrics-tls" not found
Sep 17 11:53:04.451802 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451789    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-wtmp\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.452153 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.451854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.452312 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.452296    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e5fade-967a-4237-8d81-2ed4a986b8a3-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.454350 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.454329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.461511 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.461461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzv55\" (UniqueName: \"kubernetes.io/projected/17e5fade-967a-4237-8d81-2ed4a986b8a3-kube-api-access-kzv55\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.553094 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-root\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553094 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-metrics-client-ca\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553245 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-sys\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553245 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-sys\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553245 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553186    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-root\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553352 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-tls\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553352 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-textfile\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553352 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553468 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-wtmp\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553468 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553562 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms7gc\" (UniqueName: \"kubernetes.io/projected/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-kube-api-access-ms7gc\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553610 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553567    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-textfile\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553610 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-wtmp\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553711 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553677    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-metrics-client-ca\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.553979 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.553955    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.555685 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.555658    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-tls\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.555803 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.555693    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.563475 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.563455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms7gc\" (UniqueName: \"kubernetes.io/projected/816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4-kube-api-access-ms7gc\") pod \"node-exporter-mmmzx\" (UID: \"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4\") " pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.600894 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.600871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mmmzx"
Sep 17 11:53:04.612174 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:04.612145    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816e77fa_b096_4ef8_b2fa_ab28fbcfc4d4.slice/crio-63a66151608b8c7165cd591d76ba59c8e8c17a4c2f42138aa9323f9142dcc7ac WatchSource:0}: Error finding container 63a66151608b8c7165cd591d76ba59c8e8c17a4c2f42138aa9323f9142dcc7ac: Status 404 returned error can't find the container with id 63a66151608b8c7165cd591d76ba59c8e8c17a4c2f42138aa9323f9142dcc7ac
Sep 17 11:53:04.957340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.957304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:04.960007 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:04.959985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e5fade-967a-4237-8d81-2ed4a986b8a3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-gjp7k\" (UID: \"17e5fade-967a-4237-8d81-2ed4a986b8a3\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:05.135132 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.134907    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"
Sep 17 11:53:05.254917 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.254809    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmmzx" event={"ID":"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4","Type":"ContainerStarted","Data":"63a66151608b8c7165cd591d76ba59c8e8c17a4c2f42138aa9323f9142dcc7ac"}
Sep 17 11:53:05.259829 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.259721    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:53:05.264006 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.263985    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.267125 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.267101    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 11:53:05.267270 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.267252    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 11:53:05.267407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.267390    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 11:53:05.267567 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.267548    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 11:53:05.269342 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.268578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-72977\""
Sep 17 11:53:05.269342 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.268789    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 11:53:05.269342 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.268982    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 11:53:05.269342 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.269175    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 11:53:05.269342 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.269319    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 11:53:05.278131 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.277454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 11:53:05.281542 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.281521    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:53:05.361231 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361504 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361246    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361504 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361504 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361504 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361504 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-web-config\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361561    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-volume\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-out\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.361977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.361783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-kube-api-access-2ql4z\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.426343 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.426313    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k"]
Sep 17 11:53:05.462480 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462615 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462497    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-volume\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462615 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462615 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462573    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-out\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-kube-api-access-2ql4z\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462790    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.462851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462825    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.463173 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.463173 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.463173 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.462956    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-web-config\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.465388 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.464377    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.465388 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:53:05.464826    2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 17 11:53:05.465388 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:53:05.464896    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls podName:6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e nodeName:}" failed. No retries permitted until 2026-09-17 11:53:05.964875479 +0000 UTC m=+100.657323010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e") : secret "alertmanager-main-tls" not found
Sep 17 11:53:05.465611 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.465452    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.466407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.466348    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.466510 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.466447    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.467870 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.467835    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-web-config\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.468627 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.468582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.468723 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.468635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-volume\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.469042 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.469011    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.469351 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.469303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-out\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.469351 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.469329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.470140 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.470115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.479666 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.479622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-kube-api-access-2ql4z\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.571577 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:05.571507    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e5fade_967a_4237_8d81_2ed4a986b8a3.slice/crio-e8b971a68d84326b1f0f533886e5dae8ecd30f1d98bbf56db0cea8b5087d3403 WatchSource:0}: Error finding container e8b971a68d84326b1f0f533886e5dae8ecd30f1d98bbf56db0cea8b5087d3403: Status 404 returned error can't find the container with id e8b971a68d84326b1f0f533886e5dae8ecd30f1d98bbf56db0cea8b5087d3403
Sep 17 11:53:05.967610 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.967482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:05.970813 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:05.970787    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:06.179617 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.179592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:53:06.267129 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.267018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvjnx" event={"ID":"d5b6bbbd-5113-4e38-9a9d-193c7b39306a","Type":"ContainerStarted","Data":"8131462fe733fcfea1c8090feb41eee3c51d728ce2bb17537e69c39c3a2b518f"}
Sep 17 11:53:06.275412 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.272816    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmmzx" event={"ID":"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4","Type":"ContainerStarted","Data":"77e026288456f029e2eedadacec7d7a25935ac7b2db2b76ca94418c4fce843c6"}
Sep 17 11:53:06.276638 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.276546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k" event={"ID":"17e5fade-967a-4237-8d81-2ed4a986b8a3","Type":"ContainerStarted","Data":"fd6a75ee0d6a5824909580c32032e8586cb25b2bc9a816bb4a4a1e3b6922afbb"}
Sep 17 11:53:06.276638 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.276604    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k" event={"ID":"17e5fade-967a-4237-8d81-2ed4a986b8a3","Type":"ContainerStarted","Data":"fb90d801f850d56ace3a1cd9bb0d25c62797ffa090835f877d381b70fdf884e1"}
Sep 17 11:53:06.276638 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.276633    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k" event={"ID":"17e5fade-967a-4237-8d81-2ed4a986b8a3","Type":"ContainerStarted","Data":"e8b971a68d84326b1f0f533886e5dae8ecd30f1d98bbf56db0cea8b5087d3403"}
Sep 17 11:53:06.277182 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.277161    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:53:06.491202 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:06.491029    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:53:06.493080 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:06.493056    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afdf04a_bdd4_4d1a_bb36_7c8fb25e6e1e.slice/crio-d565fd0f3b0e2165fb0ad5a48bc09fc508c7d253996800db4db8d5781541a06c WatchSource:0}: Error finding container d565fd0f3b0e2165fb0ad5a48bc09fc508c7d253996800db4db8d5781541a06c: Status 404 returned error can't find the container with id d565fd0f3b0e2165fb0ad5a48bc09fc508c7d253996800db4db8d5781541a06c
Sep 17 11:53:07.284098 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:07.284060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"d565fd0f3b0e2165fb0ad5a48bc09fc508c7d253996800db4db8d5781541a06c"}
Sep 17 11:53:07.287659 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:07.286844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xvjnx" event={"ID":"d5b6bbbd-5113-4e38-9a9d-193c7b39306a","Type":"ContainerStarted","Data":"28954c25d1ffa6563da24986b0ffa42ba8726922b5bb3710b37aea1a6ae66730"}
Sep 17 11:53:07.287659 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:07.287578    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:53:07.289530 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:07.289508    2571 generic.go:356] "Generic (PLEG): container finished" podID="816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4" containerID="77e026288456f029e2eedadacec7d7a25935ac7b2db2b76ca94418c4fce843c6" exitCode=0
Sep 17 11:53:07.289638 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:07.289548    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmmzx" event={"ID":"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4","Type":"ContainerDied","Data":"77e026288456f029e2eedadacec7d7a25935ac7b2db2b76ca94418c4fce843c6"}
Sep 17 11:53:07.312438 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:07.312390    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xvjnx" podStartSLOduration=66.444148642 podStartE2EDuration="1m8.312371745s" totalImagesPullingTime="1.868223103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:51:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:07.30988381 +0000 UTC m=+102.002331341" watchObservedRunningTime="2026-09-17 11:53:07.312371745 +0000 UTC m=+102.004819273"
Sep 17 11:53:08.132383 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:08.132356    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxvq8"
Sep 17 11:53:08.301391 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:08.301364    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k" event={"ID":"17e5fade-967a-4237-8d81-2ed4a986b8a3","Type":"ContainerStarted","Data":"32c3baef189b51c49b90a50cf0540d9fb4c2f2ecbc6c160257ea0b2adaedc907"}
Sep 17 11:53:09.306926 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.306896    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a" exitCode=0
Sep 17 11:53:09.307336 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.306933    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"}
Sep 17 11:53:09.310001 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.309976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmmzx" event={"ID":"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4","Type":"ContainerStarted","Data":"888351564f27237b98054013ad0e68665bba00973c805591400b4f68f4af821a"}
Sep 17 11:53:09.310105 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.310024    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mmmzx" event={"ID":"816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4","Type":"ContainerStarted","Data":"8e8ef9a8e6a8644df03c8a89154c426f85775243ae7981503fb4b46bdfda4e96"}
Sep 17 11:53:09.389141 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.389099    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mmmzx" podStartSLOduration=3.821602759 podStartE2EDuration="5.389084278s" totalImagesPullingTime="1.47022819s" totalInitContainerRuntime="97.253329ms" isStatefulPod=true podCreationTimestamp="2026-09-17 11:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:09.38857878 +0000 UTC m=+104.081026310" watchObservedRunningTime="2026-09-17 11:53:09.389084278 +0000 UTC m=+104.081531799"
Sep 17 11:53:09.414911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.414873    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-gjp7k" podStartSLOduration=3.468866221 podStartE2EDuration="5.414860405s" totalImagesPullingTime="1.945994184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:53:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:09.413869006 +0000 UTC m=+104.106316536" watchObservedRunningTime="2026-09-17 11:53:09.414860405 +0000 UTC m=+104.107307934"
Sep 17 11:53:09.506688 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.506636    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b49698d4b-slqg9"]
Sep 17 11:53:09.527650 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.527632    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.540246 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.540227    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 11:53:09.542976 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.542961    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 11:53:09.543258 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.543243    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 11:53:09.543830 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.543816    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-njb69\""
Sep 17 11:53:09.544886 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.544872    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 11:53:09.548951 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.548931    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b49698d4b-slqg9"]
Sep 17 11:53:09.558050 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.558025    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 11:53:09.566437 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.566423    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 11:53:09.696266 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-metrics-client-ca\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696438 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9759\" (UniqueName: \"kubernetes.io/projected/899f222b-676e-4060-b1c9-7a8be61fd290-kube-api-access-v9759\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696438 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696438 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-secret-telemeter-client\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696438 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696421    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696640 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696458    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-serving-certs-ca-bundle\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696640 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696480    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-federate-client-tls\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.696640 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.696512    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-telemeter-client-tls\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797526 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797472    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-metrics-client-ca\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797526 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9759\" (UniqueName: \"kubernetes.io/projected/899f222b-676e-4060-b1c9-7a8be61fd290-kube-api-access-v9759\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797648 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797648 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-secret-telemeter-client\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797648 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797825 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-serving-certs-ca-bundle\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797825 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-federate-client-tls\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.797825 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.797704    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-telemeter-client-tls\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.798361 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.798338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-metrics-client-ca\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.798454 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.798382    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-serving-certs-ca-bundle\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.798650 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.798626    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/899f222b-676e-4060-b1c9-7a8be61fd290-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.800310 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.800288    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.800547 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.800521    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-telemeter-client-tls\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.800743 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.800728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-federate-client-tls\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.800918 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.800896    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/899f222b-676e-4060-b1c9-7a8be61fd290-secret-telemeter-client\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.814977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.814959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9759\" (UniqueName: \"kubernetes.io/projected/899f222b-676e-4060-b1c9-7a8be61fd290-kube-api-access-v9759\") pod \"telemeter-client-5b49698d4b-slqg9\" (UID: \"899f222b-676e-4060-b1c9-7a8be61fd290\") " pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:09.836698 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:09.836681    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9"
Sep 17 11:53:10.151287 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:10.151134    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b49698d4b-slqg9"]
Sep 17 11:53:10.153698 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:10.153674    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod899f222b_676e_4060_b1c9_7a8be61fd290.slice/crio-854832b01279f510c493e7ad6fe0ea3e7a02dc8baf85f36b95079b9f1671cd88 WatchSource:0}: Error finding container 854832b01279f510c493e7ad6fe0ea3e7a02dc8baf85f36b95079b9f1671cd88: Status 404 returned error can't find the container with id 854832b01279f510c493e7ad6fe0ea3e7a02dc8baf85f36b95079b9f1671cd88
Sep 17 11:53:10.316610 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:10.316563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9" event={"ID":"899f222b-676e-4060-b1c9-7a8be61fd290","Type":"ContainerStarted","Data":"854832b01279f510c493e7ad6fe0ea3e7a02dc8baf85f36b95079b9f1671cd88"}
Sep 17 11:53:11.327231 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:11.327201    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"}
Sep 17 11:53:11.327532 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:11.327288    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"}
Sep 17 11:53:11.327532 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:11.327332    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"}
Sep 17 11:53:11.327532 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:11.327370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"}
Sep 17 11:53:11.327532 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:11.327408    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"}
Sep 17 11:53:12.332649 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.332618    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9" event={"ID":"899f222b-676e-4060-b1c9-7a8be61fd290","Type":"ContainerStarted","Data":"0c6de51f72012f7ac26f6805b561af346046c5c35e66480de90c0d085b89a874"}
Sep 17 11:53:12.333052 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.332689    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9" event={"ID":"899f222b-676e-4060-b1c9-7a8be61fd290","Type":"ContainerStarted","Data":"b2ef76ddb1d891897814acb843eb7d32f2b172ac15ccf8925ee04839f90f8ebb"}
Sep 17 11:53:12.333052 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.332728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9" event={"ID":"899f222b-676e-4060-b1c9-7a8be61fd290","Type":"ContainerStarted","Data":"a696fa026e420b06f3863f8a008e6333f2012ddcad980f69355875564ac85b4a"}
Sep 17 11:53:12.336023 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.335999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerStarted","Data":"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"}
Sep 17 11:53:12.365573 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.365524    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b49698d4b-slqg9" podStartSLOduration=1.763864058 podStartE2EDuration="3.365510141s" totalImagesPullingTime="1.601646083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:12.364042013 +0000 UTC m=+107.056489543" watchObservedRunningTime="2026-09-17 11:53:12.365510141 +0000 UTC m=+107.057957670"
Sep 17 11:53:12.400363 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.400284    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.200755075 podStartE2EDuration="7.40026948s" totalImagesPullingTime="4.181883806s" totalInitContainerRuntime="17.630599ms" isStatefulPod=false podCreationTimestamp="2026-09-17 11:53:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:12.398569757 +0000 UTC m=+107.091017327" watchObservedRunningTime="2026-09-17 11:53:12.40026948 +0000 UTC m=+107.092717008"
Sep 17 11:53:12.563718 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.563686    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86df94d48-kxwfm"]
Sep 17 11:53:12.565858 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.565841    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.570725 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.570709    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 11:53:12.571003 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.570988    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 11:53:12.571588 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.571563    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 11:53:12.571667 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.571630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 11:53:12.571816 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.571803    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 11:53:12.571876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.571810    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 11:53:12.571876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.571842    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wtx87\""
Sep 17 11:53:12.572155 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.572136    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 11:53:12.578343 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.578326    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 11:53:12.580413 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.580396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86df94d48-kxwfm"]
Sep 17 11:53:12.722104 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722077    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-serving-cert\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.722210 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-trusted-ca-bundle\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.722210 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgxxs\" (UniqueName: \"kubernetes.io/projected/f1f9cf09-5484-4412-8472-b737b2bb8e7d-kube-api-access-kgxxs\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.722281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722224    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-service-ca\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.722281 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-oauth-serving-cert\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.722369 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722290    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-oauth-config\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.722369 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.722315    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-config\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823403 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-oauth-serving-cert\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823492 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-oauth-config\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823492 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-config\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823492 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-serving-cert\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823492 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-trusted-ca-bundle\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823719 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgxxs\" (UniqueName: \"kubernetes.io/projected/f1f9cf09-5484-4412-8472-b737b2bb8e7d-kube-api-access-kgxxs\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.823719 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.823560    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-service-ca\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.824169 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.824149    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-oauth-serving-cert\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.824340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.824322    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-trusted-ca-bundle\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.824466 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.824444    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-config\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.824549 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.824527    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-service-ca\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.826218 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.826189    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-oauth-config\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.826288 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.826218    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-serving-cert\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.833350 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.833330    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgxxs\" (UniqueName: \"kubernetes.io/projected/f1f9cf09-5484-4412-8472-b737b2bb8e7d-kube-api-access-kgxxs\") pod \"console-86df94d48-kxwfm\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") " pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:12.875527 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:12.875508    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:13.151844 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:13.151818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86df94d48-kxwfm"]
Sep 17 11:53:13.154180 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:13.154153    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1f9cf09_5484_4412_8472_b737b2bb8e7d.slice/crio-b05fe4b4dda59209eff732cc86a2a50bb5debf78b07c3efcce595dcf33389b72 WatchSource:0}: Error finding container b05fe4b4dda59209eff732cc86a2a50bb5debf78b07c3efcce595dcf33389b72: Status 404 returned error can't find the container with id b05fe4b4dda59209eff732cc86a2a50bb5debf78b07c3efcce595dcf33389b72
Sep 17 11:53:13.341132 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:13.341098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86df94d48-kxwfm" event={"ID":"f1f9cf09-5484-4412-8472-b737b2bb8e7d","Type":"ContainerStarted","Data":"b05fe4b4dda59209eff732cc86a2a50bb5debf78b07c3efcce595dcf33389b72"}
Sep 17 11:53:16.355168 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:16.355127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86df94d48-kxwfm" event={"ID":"f1f9cf09-5484-4412-8472-b737b2bb8e7d","Type":"ContainerStarted","Data":"0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6"}
Sep 17 11:53:16.377188 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:16.377145    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86df94d48-kxwfm" podStartSLOduration=1.690332629 podStartE2EDuration="4.377130567s" totalImagesPullingTime="2.686797938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:16.375939342 +0000 UTC m=+111.068386872" watchObservedRunningTime="2026-09-17 11:53:16.377130567 +0000 UTC m=+111.069578096"
Sep 17 11:53:18.229812 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:18.229781    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78c8895ff4-htrmk"
Sep 17 11:53:18.312036 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:18.312012    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xvjnx"
Sep 17 11:53:21.289191 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.289120    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" podUID="0d06b41c-71f1-460c-a682-4b41a241a696" containerName="registry" containerID="cri-o://41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8" gracePeriod=30
Sep 17 11:53:21.525394 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.525366    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:53:21.695083 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695063    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-trusted-ca\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695203 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-image-registry-private-configuration\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695203 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695135    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695203 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695167    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d06b41c-71f1-460c-a682-4b41a241a696-ca-trust-extracted\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695203 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695189    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-registry-certificates\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695395 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695207    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52hmj\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-kube-api-access-52hmj\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695395 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695226    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-installation-pull-secrets\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695395 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695293    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-bound-sa-token\") pod \"0d06b41c-71f1-460c-a682-4b41a241a696\" (UID: \"0d06b41c-71f1-460c-a682-4b41a241a696\") "
Sep 17 11:53:21.695603 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695569    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:53:21.695731 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.695670    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:53:21.698319 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.698289    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-kube-api-access-52hmj" (OuterVolumeSpecName: "kube-api-access-52hmj") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "kube-api-access-52hmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:53:21.698449 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.698333    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:53:21.698449 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.698377    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:53:21.698449 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.698424    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:53:21.698449 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.698428    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:53:21.704031 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.704010    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d06b41c-71f1-460c-a682-4b41a241a696-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0d06b41c-71f1-460c-a682-4b41a241a696" (UID: "0d06b41c-71f1-460c-a682-4b41a241a696"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:53:21.796122 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796088    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-bound-sa-token\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796122 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796117    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-trusted-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796122 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796127    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-image-registry-private-configuration\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796278 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796136    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796278 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796145    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d06b41c-71f1-460c-a682-4b41a241a696-ca-trust-extracted\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796278 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796153    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d06b41c-71f1-460c-a682-4b41a241a696-registry-certificates\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796278 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796161    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52hmj\" (UniqueName: \"kubernetes.io/projected/0d06b41c-71f1-460c-a682-4b41a241a696-kube-api-access-52hmj\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:21.796278 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:21.796169    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d06b41c-71f1-460c-a682-4b41a241a696-installation-pull-secrets\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:53:22.379655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.379619    2571 generic.go:356] "Generic (PLEG): container finished" podID="0d06b41c-71f1-460c-a682-4b41a241a696" containerID="41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8" exitCode=0
Sep 17 11:53:22.380113 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.379662    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt"
Sep 17 11:53:22.380113 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.379673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" event={"ID":"0d06b41c-71f1-460c-a682-4b41a241a696","Type":"ContainerDied","Data":"41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8"}
Sep 17 11:53:22.380113 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.379726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54cb65bf74-dw2wt" event={"ID":"0d06b41c-71f1-460c-a682-4b41a241a696","Type":"ContainerDied","Data":"03c9b42443d8315248abf0b5f24043ac967636b496eb67996014632c4fbbd1c7"}
Sep 17 11:53:22.380113 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.379756    2571 scope.go:117] "RemoveContainer" containerID="41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8"
Sep 17 11:53:22.388175 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.388154    2571 scope.go:117] "RemoveContainer" containerID="41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8"
Sep 17 11:53:22.388442 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:53:22.388424    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8\": container with ID starting with 41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8 not found: ID does not exist" containerID="41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8"
Sep 17 11:53:22.388509 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.388450    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8"} err="failed to get container status \"41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8\": rpc error: code = NotFound desc = could not find container \"41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8\": container with ID starting with 41f03ef49eeb0cbc59732409562244608ad19ac2611afc7bc973ce4148586eb8 not found: ID does not exist"
Sep 17 11:53:22.406779 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.406752    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54cb65bf74-dw2wt"]
Sep 17 11:53:22.415964 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.415943    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54cb65bf74-dw2wt"]
Sep 17 11:53:22.876075 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.876047    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:22.876232 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.876104    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:22.880809 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:22.880762    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:23.387909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:23.387886    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:53:23.833544 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:23.833494    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d06b41c-71f1-460c-a682-4b41a241a696" path="/var/lib/kubelet/pods/0d06b41c-71f1-460c-a682-4b41a241a696/volumes"
Sep 17 11:53:35.698452 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:35.698409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:53:35.703878 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:35.701741    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab3f4936-192b-45e9-bf37-03bc8928f2fa-metrics-certs\") pod \"network-metrics-daemon-2hdbd\" (UID: \"ab3f4936-192b-45e9-bf37-03bc8928f2fa\") " pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:53:35.949648 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:35.949591    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdths\""
Sep 17 11:53:35.957325 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:35.957301    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2hdbd"
Sep 17 11:53:36.240390 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:36.240317    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2hdbd"]
Sep 17 11:53:36.243108 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:53:36.243078    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3f4936_192b_45e9_bf37_03bc8928f2fa.slice/crio-52c79bb3f135feb7e696f2543e35a70b8c208bfced2a9051787c2baaeb97cb7d WatchSource:0}: Error finding container 52c79bb3f135feb7e696f2543e35a70b8c208bfced2a9051787c2baaeb97cb7d: Status 404 returned error can't find the container with id 52c79bb3f135feb7e696f2543e35a70b8c208bfced2a9051787c2baaeb97cb7d
Sep 17 11:53:36.438025 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:36.437993    2571 generic.go:356] "Generic (PLEG): container finished" podID="d1e9d6e2-b146-40c1-8740-26cf574398b5" containerID="ec9eeebeb4efd7a8ac4db2ef19cd4b26e84eed1c25a470de9eb71fec50f695c2" exitCode=0
Sep 17 11:53:36.438118 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:36.438073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7" event={"ID":"d1e9d6e2-b146-40c1-8740-26cf574398b5","Type":"ContainerDied","Data":"ec9eeebeb4efd7a8ac4db2ef19cd4b26e84eed1c25a470de9eb71fec50f695c2"}
Sep 17 11:53:36.438469 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:36.438450    2571 scope.go:117] "RemoveContainer" containerID="ec9eeebeb4efd7a8ac4db2ef19cd4b26e84eed1c25a470de9eb71fec50f695c2"
Sep 17 11:53:36.439592 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:36.439571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hdbd" event={"ID":"ab3f4936-192b-45e9-bf37-03bc8928f2fa","Type":"ContainerStarted","Data":"52c79bb3f135feb7e696f2543e35a70b8c208bfced2a9051787c2baaeb97cb7d"}
Sep 17 11:53:37.445898 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:37.445867    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-t6wm7" event={"ID":"d1e9d6e2-b146-40c1-8740-26cf574398b5","Type":"ContainerStarted","Data":"f43923973059fb1ddf7a395bc2c0cc492f8d80e45f5d23722c3a7ad40883e031"}
Sep 17 11:53:37.447596 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:37.447571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hdbd" event={"ID":"ab3f4936-192b-45e9-bf37-03bc8928f2fa","Type":"ContainerStarted","Data":"9d093b8987fd20b343ae14d6ada7800a5a79bbca0b6254891d50e62bd300f269"}
Sep 17 11:53:37.447701 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:37.447619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2hdbd" event={"ID":"ab3f4936-192b-45e9-bf37-03bc8928f2fa","Type":"ContainerStarted","Data":"aa7835ee650e2b58fdb76d3e967a4f1fd2a37fdc7ab79facb5b2e206bff9a85e"}
Sep 17 11:53:37.482369 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:37.482325    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2hdbd" podStartSLOduration=131.574315089 podStartE2EDuration="2m12.482310171s" totalImagesPullingTime="907.995082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:53:37.481021341 +0000 UTC m=+132.173468871" watchObservedRunningTime="2026-09-17 11:53:37.482310171 +0000 UTC m=+132.174757701"
Sep 17 11:53:41.466230 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:41.466193    2571 generic.go:356] "Generic (PLEG): container finished" podID="fdddb6e7-7c33-48e4-858c-8d14ac25e2f3" containerID="db60d74428687b885b5f8ea9911c8b97bf3663b86bb0586a8a4e62cb80888bad" exitCode=0
Sep 17 11:53:41.466568 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:41.466265    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h" event={"ID":"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3","Type":"ContainerDied","Data":"db60d74428687b885b5f8ea9911c8b97bf3663b86bb0586a8a4e62cb80888bad"}
Sep 17 11:53:41.466568 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:41.466554    2571 scope.go:117] "RemoveContainer" containerID="db60d74428687b885b5f8ea9911c8b97bf3663b86bb0586a8a4e62cb80888bad"
Sep 17 11:53:42.473245 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:42.473201    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-9pd7h" event={"ID":"fdddb6e7-7c33-48e4-858c-8d14ac25e2f3","Type":"ContainerStarted","Data":"716c47601f1e263e6c96e53a151742e486a98b8c61c0edba24f47d9b53b760b6"}
Sep 17 11:53:56.531184 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:56.531152    2571 generic.go:356] "Generic (PLEG): container finished" podID="4f2f6688-39b7-4147-bd59-c824eb0cd0bc" containerID="433275c5a1e5163cc09ab6da2ff06ec8df240073533011aedf5abbf6b0bcbdbc" exitCode=0
Sep 17 11:53:56.531569 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:56.531219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g7q5c" event={"ID":"4f2f6688-39b7-4147-bd59-c824eb0cd0bc","Type":"ContainerDied","Data":"433275c5a1e5163cc09ab6da2ff06ec8df240073533011aedf5abbf6b0bcbdbc"}
Sep 17 11:53:56.531569 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:56.531528    2571 scope.go:117] "RemoveContainer" containerID="433275c5a1e5163cc09ab6da2ff06ec8df240073533011aedf5abbf6b0bcbdbc"
Sep 17 11:53:57.537187 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:53:57.537144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-g7q5c" event={"ID":"4f2f6688-39b7-4147-bd59-c824eb0cd0bc","Type":"ContainerStarted","Data":"3bad22a382d55297ff1a2c152c7b8737497bd495c13a14e2e0b024a02e0452f1"}
Sep 17 11:54:20.775799 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.775711    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f457c8b5c-vdq5f"]
Sep 17 11:54:20.776164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.776028    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d06b41c-71f1-460c-a682-4b41a241a696" containerName="registry"
Sep 17 11:54:20.776164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.776041    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d06b41c-71f1-460c-a682-4b41a241a696" containerName="registry"
Sep 17 11:54:20.776164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.776098    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d06b41c-71f1-460c-a682-4b41a241a696" containerName="registry"
Sep 17 11:54:20.778578 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.778559    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.798233 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.798209    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f457c8b5c-vdq5f"]
Sep 17 11:54:20.932948 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.932915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-oauth-config\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.933114 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.933090    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-trusted-ca-bundle\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.933172 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.933147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-console-config\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.933262 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.933245    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-service-ca\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.933302 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.933274    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-serving-cert\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.933355 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.933337    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-oauth-serving-cert\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:20.933448 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:20.933432    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm45n\" (UniqueName: \"kubernetes.io/projected/8e143a47-4730-40bf-9256-2a3740663c4d-kube-api-access-dm45n\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-oauth-config\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-trusted-ca-bundle\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034164 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-console-config\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-service-ca\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-serving-cert\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034340 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-oauth-serving-cert\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.034464 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm45n\" (UniqueName: \"kubernetes.io/projected/8e143a47-4730-40bf-9256-2a3740663c4d-kube-api-access-dm45n\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.035010 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.034985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-service-ca\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.035126 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.035037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-console-config\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.035126 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.035068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-trusted-ca-bundle\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.035299 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.035277    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-oauth-serving-cert\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.036727 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.036701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-serving-cert\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.036871 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.036852    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-oauth-config\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.046617 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.046599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm45n\" (UniqueName: \"kubernetes.io/projected/8e143a47-4730-40bf-9256-2a3740663c4d-kube-api-access-dm45n\") pod \"console-6f457c8b5c-vdq5f\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") " pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.087540 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.087520    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:21.361027 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.361002    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f457c8b5c-vdq5f"]
Sep 17 11:54:21.362673 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:54:21.362649    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e143a47_4730_40bf_9256_2a3740663c4d.slice/crio-31c4534a7ae2086e7027f1bb748bcd008a84dcc18a6c3f49ddafaedba62c31a0 WatchSource:0}: Error finding container 31c4534a7ae2086e7027f1bb748bcd008a84dcc18a6c3f49ddafaedba62c31a0: Status 404 returned error can't find the container with id 31c4534a7ae2086e7027f1bb748bcd008a84dcc18a6c3f49ddafaedba62c31a0
Sep 17 11:54:21.633236 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.633149    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f457c8b5c-vdq5f" event={"ID":"8e143a47-4730-40bf-9256-2a3740663c4d","Type":"ContainerStarted","Data":"b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6"}
Sep 17 11:54:21.633236 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.633233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f457c8b5c-vdq5f" event={"ID":"8e143a47-4730-40bf-9256-2a3740663c4d","Type":"ContainerStarted","Data":"31c4534a7ae2086e7027f1bb748bcd008a84dcc18a6c3f49ddafaedba62c31a0"}
Sep 17 11:54:21.664473 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:21.664420    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f457c8b5c-vdq5f" podStartSLOduration=1.664399779 podStartE2EDuration="1.664399779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:54:21.662670959 +0000 UTC m=+176.355118488" watchObservedRunningTime="2026-09-17 11:54:21.664399779 +0000 UTC m=+176.356847313"
Sep 17 11:54:25.021114 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021085    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:54:25.021467 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021389    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="alertmanager" containerID="cri-o://2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b" gracePeriod=120
Sep 17 11:54:25.021553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021471    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-metric" containerID="cri-o://896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547" gracePeriod=120
Sep 17 11:54:25.021553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021492    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="prom-label-proxy" containerID="cri-o://3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616" gracePeriod=120
Sep 17 11:54:25.021553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021486    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="config-reloader" containerID="cri-o://065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f" gracePeriod=120
Sep 17 11:54:25.021553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021528    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy" containerID="cri-o://fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574" gracePeriod=120
Sep 17 11:54:25.021755 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.021471    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-web" containerID="cri-o://5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a" gracePeriod=120
Sep 17 11:54:25.654444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654413    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616" exitCode=0
Sep 17 11:54:25.654444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654441    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574" exitCode=0
Sep 17 11:54:25.654444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654449    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f" exitCode=0
Sep 17 11:54:25.654675 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654462    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b" exitCode=0
Sep 17 11:54:25.654675 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"}
Sep 17 11:54:25.654675 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"}
Sep 17 11:54:25.654675 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"}
Sep 17 11:54:25.654675 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:25.654623    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"}
Sep 17 11:54:26.273937 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.273914    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.371699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371632    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-metrics-client-ca\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371671    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371707    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-cluster-tls-config\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371730    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-tls-assets\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371755    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-web-config\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371797    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-web\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371826    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-volume\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371857    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-out\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.371913 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371895    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-main-db\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.372243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.371981    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-trusted-ca-bundle\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.372243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.372034    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.372243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.372063    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-kube-api-access-2ql4z\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.372243 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.372095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy\") pod \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\" (UID: \"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e\") "
Sep 17 11:54:26.372977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.372027    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:54:26.372977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.372599    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:54:26.373982 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.373940    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:54:26.375433 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.375406    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:54:26.375532 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.375457    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.375874 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.375842    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-out" (OuterVolumeSpecName: "config-out") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:54:26.376153 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.376121    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.376233 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.376166    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.376233 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.376200    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.376800 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.376756    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-kube-api-access-2ql4z" (OuterVolumeSpecName: "kube-api-access-2ql4z") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "kube-api-access-2ql4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:54:26.376900 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.376818    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-volume" (OuterVolumeSpecName: "config-volume") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.379936 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.379905    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.386019 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.385996    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-web-config" (OuterVolumeSpecName: "web-config") pod "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" (UID: "6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:26.473550 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473517    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-cluster-tls-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473550 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473546    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-tls-assets\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473550 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473555    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-web-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473564    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473573    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-volume\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473582    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-config-out\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473589    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-main-db\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473597    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473606    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-main-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473615    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-kube-api-access-2ql4z\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473623    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473631    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-metrics-client-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.473699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.473639    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:26.662177 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662106    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547" exitCode=0
Sep 17 11:54:26.662177 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662132    2571 generic.go:356] "Generic (PLEG): container finished" podID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerID="5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a" exitCode=0
Sep 17 11:54:26.662318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662186    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"}
Sep 17 11:54:26.662318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662256    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"}
Sep 17 11:54:26.662318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662194    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.662318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662292    2571 scope.go:117] "RemoveContainer" containerID="3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"
Sep 17 11:54:26.662473 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.662282    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e","Type":"ContainerDied","Data":"d565fd0f3b0e2165fb0ad5a48bc09fc508c7d253996800db4db8d5781541a06c"}
Sep 17 11:54:26.670740 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.670723    2571 scope.go:117] "RemoveContainer" containerID="896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"
Sep 17 11:54:26.678365 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.678345    2571 scope.go:117] "RemoveContainer" containerID="fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"
Sep 17 11:54:26.686013 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.685997    2571 scope.go:117] "RemoveContainer" containerID="5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"
Sep 17 11:54:26.692595 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.692580    2571 scope.go:117] "RemoveContainer" containerID="065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"
Sep 17 11:54:26.697806 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.697783    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:54:26.700122 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.700107    2571 scope.go:117] "RemoveContainer" containerID="2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"
Sep 17 11:54:26.707508 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.707490    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:54:26.707655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.707641    2571 scope.go:117] "RemoveContainer" containerID="0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"
Sep 17 11:54:26.714559 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.714543    2571 scope.go:117] "RemoveContainer" containerID="3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"
Sep 17 11:54:26.714824 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.714806    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616\": container with ID starting with 3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616 not found: ID does not exist" containerID="3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"
Sep 17 11:54:26.714880 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.714832    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"} err="failed to get container status \"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616\": rpc error: code = NotFound desc = could not find container \"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616\": container with ID starting with 3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616 not found: ID does not exist"
Sep 17 11:54:26.714880 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.714850    2571 scope.go:117] "RemoveContainer" containerID="896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"
Sep 17 11:54:26.715081 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.715063    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547\": container with ID starting with 896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547 not found: ID does not exist" containerID="896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"
Sep 17 11:54:26.715123 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715085    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"} err="failed to get container status \"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547\": rpc error: code = NotFound desc = could not find container \"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547\": container with ID starting with 896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547 not found: ID does not exist"
Sep 17 11:54:26.715123 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715098    2571 scope.go:117] "RemoveContainer" containerID="fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"
Sep 17 11:54:26.715332 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.715318    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574\": container with ID starting with fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574 not found: ID does not exist" containerID="fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"
Sep 17 11:54:26.715366 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715333    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"} err="failed to get container status \"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574\": rpc error: code = NotFound desc = could not find container \"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574\": container with ID starting with fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574 not found: ID does not exist"
Sep 17 11:54:26.715366 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715344    2571 scope.go:117] "RemoveContainer" containerID="5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"
Sep 17 11:54:26.715538 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.715523    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a\": container with ID starting with 5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a not found: ID does not exist" containerID="5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"
Sep 17 11:54:26.715576 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715542    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"} err="failed to get container status \"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a\": rpc error: code = NotFound desc = could not find container \"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a\": container with ID starting with 5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a not found: ID does not exist"
Sep 17 11:54:26.715576 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715553    2571 scope.go:117] "RemoveContainer" containerID="065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"
Sep 17 11:54:26.715782 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.715746    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f\": container with ID starting with 065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f not found: ID does not exist" containerID="065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"
Sep 17 11:54:26.715827 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715788    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"} err="failed to get container status \"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f\": rpc error: code = NotFound desc = could not find container \"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f\": container with ID starting with 065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f not found: ID does not exist"
Sep 17 11:54:26.715827 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.715808    2571 scope.go:117] "RemoveContainer" containerID="2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"
Sep 17 11:54:26.716042 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.716027    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b\": container with ID starting with 2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b not found: ID does not exist" containerID="2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"
Sep 17 11:54:26.716087 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716045    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"} err="failed to get container status \"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b\": rpc error: code = NotFound desc = could not find container \"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b\": container with ID starting with 2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b not found: ID does not exist"
Sep 17 11:54:26.716087 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716058    2571 scope.go:117] "RemoveContainer" containerID="0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"
Sep 17 11:54:26.716291 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:26.716277    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a\": container with ID starting with 0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a not found: ID does not exist" containerID="0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"
Sep 17 11:54:26.716331 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716293    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"} err="failed to get container status \"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a\": rpc error: code = NotFound desc = could not find container \"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a\": container with ID starting with 0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a not found: ID does not exist"
Sep 17 11:54:26.716331 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716306    2571 scope.go:117] "RemoveContainer" containerID="3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"
Sep 17 11:54:26.716497 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716482    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616"} err="failed to get container status \"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616\": rpc error: code = NotFound desc = could not find container \"3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616\": container with ID starting with 3d5ef7645861bacf124c557302beacd8625e8b7dbeddcde548888fe6e69ab616 not found: ID does not exist"
Sep 17 11:54:26.716540 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716498    2571 scope.go:117] "RemoveContainer" containerID="896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"
Sep 17 11:54:26.716681 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716668    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547"} err="failed to get container status \"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547\": rpc error: code = NotFound desc = could not find container \"896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547\": container with ID starting with 896416df5e9290a87063780da36985f22bf58789be1b06d6ac5b6b777a35e547 not found: ID does not exist"
Sep 17 11:54:26.716720 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716681    2571 scope.go:117] "RemoveContainer" containerID="fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"
Sep 17 11:54:26.716895 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716880    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574"} err="failed to get container status \"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574\": rpc error: code = NotFound desc = could not find container \"fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574\": container with ID starting with fb3886d8eb90a0e028ce6f255c5d71340b4be4c2e217b969b0324facfd89d574 not found: ID does not exist"
Sep 17 11:54:26.716962 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.716894    2571 scope.go:117] "RemoveContainer" containerID="5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"
Sep 17 11:54:26.717107 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717089    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a"} err="failed to get container status \"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a\": rpc error: code = NotFound desc = could not find container \"5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a\": container with ID starting with 5cb9cb4a2190196338b3962b48a85056faa270296344bd5ad594fa6d594daf2a not found: ID does not exist"
Sep 17 11:54:26.717182 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717110    2571 scope.go:117] "RemoveContainer" containerID="065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"
Sep 17 11:54:26.717348 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717334    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f"} err="failed to get container status \"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f\": rpc error: code = NotFound desc = could not find container \"065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f\": container with ID starting with 065e520d4817b02be19a7b76f42f7078b8007056ad325896a41ba74cc584232f not found: ID does not exist"
Sep 17 11:54:26.717406 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717349    2571 scope.go:117] "RemoveContainer" containerID="2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"
Sep 17 11:54:26.717540 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717525    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b"} err="failed to get container status \"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b\": rpc error: code = NotFound desc = could not find container \"2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b\": container with ID starting with 2f490a4f7e9a148ced827b19aee4a89eb24866156544db528ed6485e1f112b5b not found: ID does not exist"
Sep 17 11:54:26.717588 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717540    2571 scope.go:117] "RemoveContainer" containerID="0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"
Sep 17 11:54:26.717736 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.717719    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a"} err="failed to get container status \"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a\": rpc error: code = NotFound desc = could not find container \"0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a\": container with ID starting with 0960fc56fcae90156351a2908c70e39c28ef8322d065ac723262842b87cb027a not found: ID does not exist"
Sep 17 11:54:26.756010 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.755988    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:54:26.756261 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756250    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756263    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756273    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="alertmanager"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756278    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="alertmanager"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756284    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-metric"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756290    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-metric"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756299    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="config-reloader"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756305    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="config-reloader"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756313    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="init-config-reloader"
Sep 17 11:54:26.756318 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756319    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="init-config-reloader"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756325    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-web"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756331    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-web"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756339    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="prom-label-proxy"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756344    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="prom-label-proxy"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756393    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-metric"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756401    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="config-reloader"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756408    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756414    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="prom-label-proxy"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756420    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="alertmanager"
Sep 17 11:54:26.756623 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.756425    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" containerName="kube-rbac-proxy-web"
Sep 17 11:54:26.761296 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.761282    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.764228 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764213    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 11:54:26.764310 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 11:54:26.764425 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764403    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 11:54:26.764528 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764451    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-72977\""
Sep 17 11:54:26.764595 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 11:54:26.764639 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 11:54:26.764836 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764822    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 11:54:26.764902 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.764860    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 11:54:26.765074 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.765059    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 11:54:26.772571 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.772555    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 11:54:26.779093 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.779076    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:54:26.876960 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.876942    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01eb78c5-e8b0-425b-8751-e06c732a8642-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877054 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.876974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877054 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.876999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01eb78c5-e8b0-425b-8751-e06c732a8642-config-out\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877054 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877014    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877168 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4h9l\" (UniqueName: \"kubernetes.io/projected/01eb78c5-e8b0-425b-8751-e06c732a8642-kube-api-access-s4h9l\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877168 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877168 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877264 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877264 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01eb78c5-e8b0-425b-8751-e06c732a8642-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877264 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01eb78c5-e8b0-425b-8751-e06c732a8642-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877362 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877289    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-config-volume\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877362 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-web-config\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.877362 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.877330    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01eb78c5-e8b0-425b-8751-e06c732a8642-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978310 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978284    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01eb78c5-e8b0-425b-8751-e06c732a8642-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978394 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978325    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978394 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01eb78c5-e8b0-425b-8751-e06c732a8642-config-out\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978394 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978394 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4h9l\" (UniqueName: \"kubernetes.io/projected/01eb78c5-e8b0-425b-8751-e06c732a8642-kube-api-access-s4h9l\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978593 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978593 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978514    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978593 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978820 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01eb78c5-e8b0-425b-8751-e06c732a8642-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978820 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01eb78c5-e8b0-425b-8751-e06c732a8642-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978820 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-config-volume\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978820 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-web-config\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.978820 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.978742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01eb78c5-e8b0-425b-8751-e06c732a8642-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.979420 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.979152    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/01eb78c5-e8b0-425b-8751-e06c732a8642-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.979420 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.979332    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01eb78c5-e8b0-425b-8751-e06c732a8642-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.980092 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.980061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01eb78c5-e8b0-425b-8751-e06c732a8642-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.981684 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.981656    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.981813 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.981684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/01eb78c5-e8b0-425b-8751-e06c732a8642-config-out\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.981966 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.981941    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.982328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.982301    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.982423 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.982352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.982543 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.982524    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.982869 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.982839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/01eb78c5-e8b0-425b-8751-e06c732a8642-tls-assets\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.983134 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.983115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-config-volume\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.983929 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.983908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/01eb78c5-e8b0-425b-8751-e06c732a8642-web-config\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:26.987889 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:26.987862    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4h9l\" (UniqueName: \"kubernetes.io/projected/01eb78c5-e8b0-425b-8751-e06c732a8642-kube-api-access-s4h9l\") pod \"alertmanager-main-0\" (UID: \"01eb78c5-e8b0-425b-8751-e06c732a8642\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:27.070045 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:27.070025    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 11:54:27.352113 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:27.352088    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 11:54:27.353964 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:54:27.353939    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01eb78c5_e8b0_425b_8751_e06c732a8642.slice/crio-c2fa8546a9b0cc27a67c7d56ecd356c82f89ca2985ab8273c72bfd1fb58f2793 WatchSource:0}: Error finding container c2fa8546a9b0cc27a67c7d56ecd356c82f89ca2985ab8273c72bfd1fb58f2793: Status 404 returned error can't find the container with id c2fa8546a9b0cc27a67c7d56ecd356c82f89ca2985ab8273c72bfd1fb58f2793
Sep 17 11:54:27.668807 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:27.668719    2571 generic.go:356] "Generic (PLEG): container finished" podID="01eb78c5-e8b0-425b-8751-e06c732a8642" containerID="f635e2a5768530428d4527d7cd62594ba3817281b764347ac424181d625be1c6" exitCode=0
Sep 17 11:54:27.668807 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:27.668794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerDied","Data":"f635e2a5768530428d4527d7cd62594ba3817281b764347ac424181d625be1c6"}
Sep 17 11:54:27.668947 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:27.668890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"c2fa8546a9b0cc27a67c7d56ecd356c82f89ca2985ab8273c72bfd1fb58f2793"}
Sep 17 11:54:27.833996 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:27.833969    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e" path="/var/lib/kubelet/pods/6afdf04a-bdd4-4d1a-bb36-7c8fb25e6e1e/volumes"
Sep 17 11:54:28.677526 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.677491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"09431da9af09a8c1d5c35484a93e3e6d0784788dc5b901be3085afea19c9afd2"}
Sep 17 11:54:28.677930 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.677591    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"1457b5a050e81d5d2ba6240b14e492e680a06ea20ba251b53eef4a941ba5af4a"}
Sep 17 11:54:28.677930 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.677633    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"e296246672a50fe382c86a7f0cafff1ceb5f16f555ab2eef6b5cdc0028f16529"}
Sep 17 11:54:28.677930 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.677674    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"02192874045d02cddc371d6886370fbdd40a805550a27a844a3329f98d980ff4"}
Sep 17 11:54:28.677930 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.677711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"59b055ff0124b0c51951964b7f94d654ff123dec89eb14c5a54afa749df44599"}
Sep 17 11:54:28.677930 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.677744    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"01eb78c5-e8b0-425b-8751-e06c732a8642","Type":"ContainerStarted","Data":"81ed51e803fbc908ccacf76131746a069bdeb3343f81ba3bba6af6ddb0326a1e"}
Sep 17 11:54:28.707521 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:28.707478    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.690934955 podStartE2EDuration="2.707463252s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.528297ms" isStatefulPod=false podCreationTimestamp="2026-09-17 11:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:54:28.706498666 +0000 UTC m=+183.398946195" watchObservedRunningTime="2026-09-17 11:54:28.707463252 +0000 UTC m=+183.399910782"
Sep 17 11:54:31.088206 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:31.088172    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:31.088593 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:31.088270    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:31.093021 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:31.092997    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:31.694514 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:31.694489    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:54:31.787932 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:31.787904    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86df94d48-kxwfm"]
Sep 17 11:54:56.806922 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:56.806856    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86df94d48-kxwfm" podUID="f1f9cf09-5484-4412-8472-b737b2bb8e7d" containerName="console" containerID="cri-o://0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6" gracePeriod=15
Sep 17 11:54:57.055669 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.055645    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:54:57.092655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092590    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-service-ca\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.092655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092628    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-config\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.092876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092704    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-serving-cert\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.092876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092730    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-oauth-serving-cert\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.092876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092780    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-trusted-ca-bundle\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.092876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092825    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgxxs\" (UniqueName: \"kubernetes.io/projected/f1f9cf09-5484-4412-8472-b737b2bb8e7d-kube-api-access-kgxxs\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.092876 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.092874    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-oauth-config\") pod \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\" (UID: \"f1f9cf09-5484-4412-8472-b737b2bb8e7d\") "
Sep 17 11:54:57.093106 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.093021    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:54:57.093168 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.093111    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:54:57.093168 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.093127    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-config" (OuterVolumeSpecName: "console-config") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:54:57.093319 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.093292    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:54:57.095254 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.095219    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f9cf09-5484-4412-8472-b737b2bb8e7d-kube-api-access-kgxxs" (OuterVolumeSpecName: "kube-api-access-kgxxs") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "kube-api-access-kgxxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:54:57.095254 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.095243    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:57.095386 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.095293    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1f9cf09-5484-4412-8472-b737b2bb8e7d" (UID: "f1f9cf09-5484-4412-8472-b737b2bb8e7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:54:57.193946 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.193920    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-oauth-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.193946 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.193944    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-service-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.194089 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.193958    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.194089 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.193970    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1f9cf09-5484-4412-8472-b737b2bb8e7d-console-serving-cert\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.194089 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.193981    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-oauth-serving-cert\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.194089 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.193993    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1f9cf09-5484-4412-8472-b737b2bb8e7d-trusted-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.194089 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.194005    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgxxs\" (UniqueName: \"kubernetes.io/projected/f1f9cf09-5484-4412-8472-b737b2bb8e7d-kube-api-access-kgxxs\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:54:57.810254 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.810218    2571 generic.go:356] "Generic (PLEG): container finished" podID="f1f9cf09-5484-4412-8472-b737b2bb8e7d" containerID="0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6" exitCode=0
Sep 17 11:54:57.810719 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.810271    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86df94d48-kxwfm"
Sep 17 11:54:57.810719 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.810276    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86df94d48-kxwfm" event={"ID":"f1f9cf09-5484-4412-8472-b737b2bb8e7d","Type":"ContainerDied","Data":"0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6"}
Sep 17 11:54:57.810719 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.810322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86df94d48-kxwfm" event={"ID":"f1f9cf09-5484-4412-8472-b737b2bb8e7d","Type":"ContainerDied","Data":"b05fe4b4dda59209eff732cc86a2a50bb5debf78b07c3efcce595dcf33389b72"}
Sep 17 11:54:57.810719 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.810343    2571 scope.go:117] "RemoveContainer" containerID="0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6"
Sep 17 11:54:57.820308 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.820289    2571 scope.go:117] "RemoveContainer" containerID="0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6"
Sep 17 11:54:57.820602 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:54:57.820582    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6\": container with ID starting with 0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6 not found: ID does not exist" containerID="0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6"
Sep 17 11:54:57.820640 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.820611    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6"} err="failed to get container status \"0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6\": rpc error: code = NotFound desc = could not find container \"0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6\": container with ID starting with 0d1908a5a24f70c9870b6e6d3ae5f7d3ae1d6f190d49cda9e4608bb2d8ca03f6 not found: ID does not exist"
Sep 17 11:54:57.834237 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.834215    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86df94d48-kxwfm"]
Sep 17 11:54:57.838660 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:57.838634    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86df94d48-kxwfm"]
Sep 17 11:54:59.832553 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:54:59.832507    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f9cf09-5484-4412-8472-b737b2bb8e7d" path="/var/lib/kubelet/pods/f1f9cf09-5484-4412-8472-b737b2bb8e7d/volumes"
Sep 17 11:56:25.743572 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:25.743543    2571 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 11:56:32.211407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.211369    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"]
Sep 17 11:56:32.213784 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.211817    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f9cf09-5484-4412-8472-b737b2bb8e7d" containerName="console"
Sep 17 11:56:32.213784 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.211836    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f9cf09-5484-4412-8472-b737b2bb8e7d" containerName="console"
Sep 17 11:56:32.213784 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.211914    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f9cf09-5484-4412-8472-b737b2bb8e7d" containerName="console"
Sep 17 11:56:32.214733 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.214714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:56:32.218554 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.218533    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-4czkw\""
Sep 17 11:56:32.218648 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.218574    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 17 11:56:32.219197 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.219184    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 17 11:56:32.252442 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.252416    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"]
Sep 17 11:56:32.357868 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.357848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc8nm\" (UniqueName: \"kubernetes.io/projected/6bb0d961-5b6b-4fb5-9da0-03ca1179f890-kube-api-access-fc8nm\") pod \"feast-operator-controller-manager-5b6bb4b554-cmjtn\" (UID: \"6bb0d961-5b6b-4fb5-9da0-03ca1179f890\") " pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:56:32.458984 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.458961    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc8nm\" (UniqueName: \"kubernetes.io/projected/6bb0d961-5b6b-4fb5-9da0-03ca1179f890-kube-api-access-fc8nm\") pod \"feast-operator-controller-manager-5b6bb4b554-cmjtn\" (UID: \"6bb0d961-5b6b-4fb5-9da0-03ca1179f890\") " pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:56:32.468521 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.468477    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc8nm\" (UniqueName: \"kubernetes.io/projected/6bb0d961-5b6b-4fb5-9da0-03ca1179f890-kube-api-access-fc8nm\") pod \"feast-operator-controller-manager-5b6bb4b554-cmjtn\" (UID: \"6bb0d961-5b6b-4fb5-9da0-03ca1179f890\") " pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:56:32.524078 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.524054    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:56:32.796335 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.796311    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"]
Sep 17 11:56:32.798538 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:56:32.798511    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb0d961_5b6b_4fb5_9da0_03ca1179f890.slice/crio-b9644fdd68a244b5b17b1b3fd69fc6aaf5a8969bf3f8b7cf145a346b28ad3972 WatchSource:0}: Error finding container b9644fdd68a244b5b17b1b3fd69fc6aaf5a8969bf3f8b7cf145a346b28ad3972: Status 404 returned error can't find the container with id b9644fdd68a244b5b17b1b3fd69fc6aaf5a8969bf3f8b7cf145a346b28ad3972
Sep 17 11:56:32.800699 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:32.800679    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 11:56:33.178399 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:33.178328    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn" event={"ID":"6bb0d961-5b6b-4fb5-9da0-03ca1179f890","Type":"ContainerStarted","Data":"b9644fdd68a244b5b17b1b3fd69fc6aaf5a8969bf3f8b7cf145a346b28ad3972"}
Sep 17 11:56:35.190759 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:35.190725    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn" event={"ID":"6bb0d961-5b6b-4fb5-9da0-03ca1179f890","Type":"ContainerStarted","Data":"24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b"}
Sep 17 11:56:35.191103 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:35.190822    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:56:35.210174 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:35.210127    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn" podStartSLOduration=0.954691191 podStartE2EDuration="3.21011524s" totalImagesPullingTime="2.255424049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:56:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:56:35.209865025 +0000 UTC m=+309.902312580" watchObservedRunningTime="2026-09-17 11:56:35.21011524 +0000 UTC m=+309.902562770"
Sep 17 11:56:46.199737 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:56:46.199693    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 11:57:09.165390 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.165357    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"]
Sep 17 11:57:09.172148 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.172127    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.175089 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175070    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 11:57:09.175212 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175110    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 11:57:09.175212 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175152    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 11:57:09.175335 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 11:57:09.175394 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175366    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 11:57:09.175446 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ng72l\""
Sep 17 11:57:09.175517 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175500    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 11:57:09.175652 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.175633    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 17 11:57:09.184465 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.184440    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"]
Sep 17 11:57:09.214717 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.214679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-ui-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.214851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.214750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.214851 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.214843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-online-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.214968 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.214910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vkl\" (UniqueName: \"kubernetes.io/projected/dc2d8837-108b-4ff1-8cd7-7147515f841a-kube-api-access-m4vkl\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.214968 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.214952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2d8837-108b-4ff1-8cd7-7147515f841a-feast-data\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.215085 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.215048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-offline-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315551 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.315528    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-ui-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.315556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.315583    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-online-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.315623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vkl\" (UniqueName: \"kubernetes.io/projected/dc2d8837-108b-4ff1-8cd7-7147515f841a-kube-api-access-m4vkl\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315655 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.315644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2d8837-108b-4ff1-8cd7-7147515f841a-feast-data\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315900 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.315663    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-offline-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.315900 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:57:09.315678    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 11:57:09.315900 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:57:09.315736    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls podName:dc2d8837-108b-4ff1-8cd7-7147515f841a nodeName:}" failed. No retries permitted until 2026-09-17 11:57:09.815716347 +0000 UTC m=+344.508163872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls") pod "feast-simple-feast-setup-665f95d49f-tw9wj" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 11:57:09.316095 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.316065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2d8837-108b-4ff1-8cd7-7147515f841a-feast-data\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.318390 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.318368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-online-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.318502 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.318485    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-ui-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.318653 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.318635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-offline-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.327909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.327884    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vkl\" (UniqueName: \"kubernetes.io/projected/dc2d8837-108b-4ff1-8cd7-7147515f841a-kube-api-access-m4vkl\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.818712 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.818686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:09.821169 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:09.821133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-tw9wj\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:10.093496 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:10.093420    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:10.387086 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:10.387056    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"]
Sep 17 11:57:10.388160 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:57:10.388138    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc2d8837_108b_4ff1_8cd7_7147515f841a.slice/crio-909378b9f88c24ca25e693f46be180b213a3714d4d6366702bd4cc473baedd27 WatchSource:0}: Error finding container 909378b9f88c24ca25e693f46be180b213a3714d4d6366702bd4cc473baedd27: Status 404 returned error can't find the container with id 909378b9f88c24ca25e693f46be180b213a3714d4d6366702bd4cc473baedd27
Sep 17 11:57:11.337031 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:11.336966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"909378b9f88c24ca25e693f46be180b213a3714d4d6366702bd4cc473baedd27"}
Sep 17 11:57:36.447465 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:36.447426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"28d54f902c3d60eef2b0b01047881e4b3ee5f45587c895a183547c2584d43b90"}
Sep 17 11:57:41.469705 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:41.469676    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerID="28d54f902c3d60eef2b0b01047881e4b3ee5f45587c895a183547c2584d43b90" exitCode=0
Sep 17 11:57:41.470086 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:41.469727    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"28d54f902c3d60eef2b0b01047881e4b3ee5f45587c895a183547c2584d43b90"}
Sep 17 11:57:42.475223 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:42.475191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"43f12f634ae20e8a114368944da6c42a57c207ae8a15e6959722f61bf16508b1"}
Sep 17 11:57:47.499756 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:47.499721    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerID="43f12f634ae20e8a114368944da6c42a57c207ae8a15e6959722f61bf16508b1" exitCode=0
Sep 17 11:57:47.500162 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:47.499814    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"43f12f634ae20e8a114368944da6c42a57c207ae8a15e6959722f61bf16508b1"}
Sep 17 11:57:47.509543 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:47.509523    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 17 11:57:48.521737 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:48.521696    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"d905aed185cc23060eaf93791f012065664f085730434220a5820083739371bf"}
Sep 17 11:57:48.522235 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:48.521759    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"f4c313d50324fe574d8a4c05e7aba474a3d772cc91fd8d45f6faf957f7633b7e"}
Sep 17 11:57:48.522235 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:48.521809    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"a97b6944a28bd8c3682bbb186bec530b1b611bcd2456f239a2ecde02f5333bfc"}
Sep 17 11:57:48.522235 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:48.521826    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerStarted","Data":"d1b8df83d954f22fe7b5f5bd336519c6b40d090569c90b1aceb1c1da190d24ed"}
Sep 17 11:57:48.564997 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:48.564282    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podStartSLOduration=14.107942874999999 podStartE2EDuration="39.564259658s" totalImagesPullingTime="25.456316783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:57:48.561890358 +0000 UTC m=+383.254337880" watchObservedRunningTime="2026-09-17 11:57:48.564259658 +0000 UTC m=+383.256707208"
Sep 17 11:57:49.093935 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.093897    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:49.094142 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.093964    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:49.094142 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.093984    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:49.094142 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.094001    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:49.096238 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.096193    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 17 11:57:49.096238 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.096215    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
Sep 17 11:57:49.096444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.096216    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
Sep 17 11:57:49.096444 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:49.096270    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 17 11:57:50.093925 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:50.093883    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:50.094474 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:50.094451    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:50.094474 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:50.094484    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:50.094683 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:50.094507    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:52.094662 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:52.094624    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
Sep 17 11:57:52.095263 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:52.094623    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 17 11:57:52.095402 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:52.094624    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.24:8816: connect: connection refused"
Sep 17 11:57:52.095402 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:52.094692    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 17 11:57:55.093973 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:55.093907    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.24:6571: connect: connection refused"
Sep 17 11:57:55.094411 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:55.093918    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 17 11:57:55.094965 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:55.094931    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:55.095854 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:55.095833    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:55.100038 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:55.100022    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:55.570906 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:55.570879    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:58.094733 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:58.094707    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:58.095126 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:58.094855    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:58.578349 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:58.578321    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:57:58.578545 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:57:58.578531    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:58:16.474994 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:16.474961    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f457c8b5c-vdq5f"]
Sep 17 11:58:41.494007 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.493940    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f457c8b5c-vdq5f" podUID="8e143a47-4730-40bf-9256-2a3740663c4d" containerName="console" containerID="cri-o://b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6" gracePeriod=15
Sep 17 11:58:41.739684 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.739664    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:58:41.745954 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.745902    2571 generic.go:356] "Generic (PLEG): container finished" podID="8e143a47-4730-40bf-9256-2a3740663c4d" containerID="b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6" exitCode=0
Sep 17 11:58:41.745954 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.745940    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f457c8b5c-vdq5f"
Sep 17 11:58:41.746121 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.745969    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f457c8b5c-vdq5f" event={"ID":"8e143a47-4730-40bf-9256-2a3740663c4d","Type":"ContainerDied","Data":"b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6"}
Sep 17 11:58:41.746121 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.746047    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f457c8b5c-vdq5f" event={"ID":"8e143a47-4730-40bf-9256-2a3740663c4d","Type":"ContainerDied","Data":"31c4534a7ae2086e7027f1bb748bcd008a84dcc18a6c3f49ddafaedba62c31a0"}
Sep 17 11:58:41.746121 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.746074    2571 scope.go:117] "RemoveContainer" containerID="b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6"
Sep 17 11:58:41.753748 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.753732    2571 scope.go:117] "RemoveContainer" containerID="b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6"
Sep 17 11:58:41.754044 ip-10-0-142-23 kubenswrapper[2571]: E0917 11:58:41.754025    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6\": container with ID starting with b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6 not found: ID does not exist" containerID="b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6"
Sep 17 11:58:41.754101 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.754053    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6"} err="failed to get container status \"b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6\": rpc error: code = NotFound desc = could not find container \"b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6\": container with ID starting with b9b2f43059ffb74023f64241e4c474cd701324b57c799be4d2d9bb08b46311e6 not found: ID does not exist"
Sep 17 11:58:41.811126 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811102    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-oauth-config\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811214 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811144    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm45n\" (UniqueName: \"kubernetes.io/projected/8e143a47-4730-40bf-9256-2a3740663c4d-kube-api-access-dm45n\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811214 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811182    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-trusted-ca-bundle\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811214 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811205    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-serving-cert\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811237    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-oauth-serving-cert\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811277    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-service-ca\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811328 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811313    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-console-config\") pod \"8e143a47-4730-40bf-9256-2a3740663c4d\" (UID: \"8e143a47-4730-40bf-9256-2a3740663c4d\") "
Sep 17 11:58:41.811683 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811657    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:58:41.811683 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811667    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:58:41.812029 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.811881    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:58:41.812107 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.812073    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-console-config" (OuterVolumeSpecName: "console-config") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:58:41.813343 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.813318    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:58:41.813442 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.813366    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e143a47-4730-40bf-9256-2a3740663c4d-kube-api-access-dm45n" (OuterVolumeSpecName: "kube-api-access-dm45n") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "kube-api-access-dm45n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:58:41.813442 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.813435    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e143a47-4730-40bf-9256-2a3740663c4d" (UID: "8e143a47-4730-40bf-9256-2a3740663c4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:58:41.911959 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.911938    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-console-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:41.911959 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.911957    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-oauth-config\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:41.912075 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.911967    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm45n\" (UniqueName: \"kubernetes.io/projected/8e143a47-4730-40bf-9256-2a3740663c4d-kube-api-access-dm45n\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:41.912075 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.911976    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-trusted-ca-bundle\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:41.912075 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.911985    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e143a47-4730-40bf-9256-2a3740663c4d-console-serving-cert\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:41.912075 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.911993    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-oauth-serving-cert\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:41.912075 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:41.912001    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e143a47-4730-40bf-9256-2a3740663c4d-service-ca\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:58:42.062604 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:42.062541    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f457c8b5c-vdq5f"]
Sep 17 11:58:42.066369 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:42.066341    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f457c8b5c-vdq5f"]
Sep 17 11:58:42.691896 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:42.691857    2571 patch_prober.go:28] interesting pod/console-6f457c8b5c-vdq5f container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.21:8443/health\": context deadline exceeded" start-of-body=
Sep 17 11:58:42.692305 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:42.691935    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6f457c8b5c-vdq5f" podUID="8e143a47-4730-40bf-9256-2a3740663c4d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": context deadline exceeded"
Sep 17 11:58:43.832607 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:58:43.832572    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e143a47-4730-40bf-9256-2a3740663c4d" path="/var/lib/kubelet/pods/8e143a47-4730-40bf-9256-2a3740663c4d/volumes"
Sep 17 11:59:01.468809 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.468780    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"]
Sep 17 11:59:01.469269 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.469029    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry" containerID="cri-o://d1b8df83d954f22fe7b5f5bd336519c6b40d090569c90b1aceb1c1da190d24ed" gracePeriod=30
Sep 17 11:59:01.469269 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.469069    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="offline" containerID="cri-o://f4c313d50324fe574d8a4c05e7aba474a3d772cc91fd8d45f6faf957f7633b7e" gracePeriod=30
Sep 17 11:59:01.469269 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.469076    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" containerID="cri-o://d905aed185cc23060eaf93791f012065664f085730434220a5820083739371bf" gracePeriod=30
Sep 17 11:59:01.469269 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.469121    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online" containerID="cri-o://a97b6944a28bd8c3682bbb186bec530b1b611bcd2456f239a2ecde02f5333bfc" gracePeriod=30
Sep 17 11:59:01.900922 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.900818    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"]
Sep 17 11:59:01.901258 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.901238    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e143a47-4730-40bf-9256-2a3740663c4d" containerName="console"
Sep 17 11:59:01.901355 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.901260    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e143a47-4730-40bf-9256-2a3740663c4d" containerName="console"
Sep 17 11:59:01.901407 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.901373    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e143a47-4730-40bf-9256-2a3740663c4d" containerName="console"
Sep 17 11:59:01.904818 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.904788    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:01.907707 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.907685    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bd946\""
Sep 17 11:59:01.922253 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.922207    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"]
Sep 17 11:59:01.954604 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.954573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56e5e0-b344-4999-93f0-a90c396e1fe1-feast-data\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:01.954604 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.954610    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5tsh\" (UniqueName: \"kubernetes.io/projected/fb56e5e0-b344-4999-93f0-a90c396e1fe1-kube-api-access-h5tsh\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:01.954909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.954659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-online-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:01.954909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.954699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-offline-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:01.954909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.954737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-ui-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:01.954909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:01.954758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055309 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-online-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-offline-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-ui-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055416 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055572 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56e5e0-b344-4999-93f0-a90c396e1fe1-feast-data\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055572 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5tsh\" (UniqueName: \"kubernetes.io/projected/fb56e5e0-b344-4999-93f0-a90c396e1fe1-kube-api-access-h5tsh\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.055977 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.055943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56e5e0-b344-4999-93f0-a90c396e1fe1-feast-data\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.058404 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.058370    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-registry-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.058404 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.058378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-ui-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.058550 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.058466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-offline-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.058550 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.058502    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-online-tls\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.064652 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.064628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5tsh\" (UniqueName: \"kubernetes.io/projected/fb56e5e0-b344-4999-93f0-a90c396e1fe1-kube-api-access-h5tsh\") pod \"feast-simple-feast-setup-665f95d49f-g7zc2\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") " pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.214919 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.214894    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:02.495044 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.495018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"]
Sep 17 11:59:02.496316 ip-10-0-142-23 kubenswrapper[2571]: W0917 11:59:02.496290    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb56e5e0_b344_4999_93f0_a90c396e1fe1.slice/crio-4ce9bf2ae83b3e0a00bbccd89015e3943b186b843cac6fe227c0eed87b223a42 WatchSource:0}: Error finding container 4ce9bf2ae83b3e0a00bbccd89015e3943b186b843cac6fe227c0eed87b223a42: Status 404 returned error can't find the container with id 4ce9bf2ae83b3e0a00bbccd89015e3943b186b843cac6fe227c0eed87b223a42
Sep 17 11:59:02.840482 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.840393    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"63a4009ea02a1875b0158dfa94b811efa6dfcaedf1cdb3ab2d86dd088ff9494f"}
Sep 17 11:59:02.840482 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.840440    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"4ce9bf2ae83b3e0a00bbccd89015e3943b186b843cac6fe227c0eed87b223a42"}
Sep 17 11:59:02.843549 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.843524    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerID="d905aed185cc23060eaf93791f012065664f085730434220a5820083739371bf" exitCode=0
Sep 17 11:59:02.843549 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.843546    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerID="a97b6944a28bd8c3682bbb186bec530b1b611bcd2456f239a2ecde02f5333bfc" exitCode=0
Sep 17 11:59:02.843701 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.843596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"d905aed185cc23060eaf93791f012065664f085730434220a5820083739371bf"}
Sep 17 11:59:02.843701 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:02.843636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"a97b6944a28bd8c3682bbb186bec530b1b611bcd2456f239a2ecde02f5333bfc"}
Sep 17 11:59:05.568506 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:05.568466    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 17 11:59:08.578888 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:08.578856    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 17 11:59:08.869492 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:08.869420    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerID="63a4009ea02a1875b0158dfa94b811efa6dfcaedf1cdb3ab2d86dd088ff9494f" exitCode=0
Sep 17 11:59:08.869614 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:08.869493    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"63a4009ea02a1875b0158dfa94b811efa6dfcaedf1cdb3ab2d86dd088ff9494f"}
Sep 17 11:59:09.875184 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:09.875155    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"3b453c6deca870c27659bd6dc656edf65d3af9796df696b34f76254173e94f8f"}
Sep 17 11:59:14.897246 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:14.897169    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerID="3b453c6deca870c27659bd6dc656edf65d3af9796df696b34f76254173e94f8f" exitCode=0
Sep 17 11:59:14.897608 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:14.897238    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"3b453c6deca870c27659bd6dc656edf65d3af9796df696b34f76254173e94f8f"}
Sep 17 11:59:15.568648 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:15.568600    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 17 11:59:15.907733 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:15.907645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"fb787e6460059937b69f293f2b6ccfa4377253bc4503cdd4660cf8b0343037c1"}
Sep 17 11:59:15.907733 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:15.907697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"0b85061362ff94305d205e194b2bcab705a14fca1ffbcedd74ce3bb89edbcb27"}
Sep 17 11:59:15.907733 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:15.907717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"90783f0720d5c9afb6336f3708ec472a551e8a07f850bd8b20a100e68093c959"}
Sep 17 11:59:15.908327 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:15.907736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerStarted","Data":"7b65b34de6653bc38cf0550b7ea69d99a15fe0e8a1d0bc5956d3d21181d69a68"}
Sep 17 11:59:15.956637 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:15.956571    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podStartSLOduration=14.956550251 podStartE2EDuration="14.956550251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:59:15.955928951 +0000 UTC m=+470.648376484" watchObservedRunningTime="2026-09-17 11:59:15.956550251 +0000 UTC m=+470.648997782"
Sep 17 11:59:17.215607 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.215563    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:17.216108 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.215628    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:17.216108 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.215649    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:17.216108 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.215666    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:17.217911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.217869    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused"
Sep 17 11:59:17.217911 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.217894    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused"
Sep 17 11:59:17.218105 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.217903    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
Sep 17 11:59:17.218105 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:17.217996    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
Sep 17 11:59:18.578258 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:18.578214    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 17 11:59:20.215787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:20.215716    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused"
Sep 17 11:59:20.215787 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:20.215709    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
Sep 17 11:59:20.216319 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:20.215716    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused"
Sep 17 11:59:20.216319 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:20.215757    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
Sep 17 11:59:22.216013 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:22.215969    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:22.216608 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:22.216583    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:22.216608 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:22.216617    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:22.216827 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:22.216639    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:23.215358 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.215311    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
Sep 17 11:59:23.216180 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.216154    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:23.216620 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.216268    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:23.216620 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.216466    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:23.217096 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.217074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:23.217234 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.217223    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:23.217288 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:23.217265    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:25.567904 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:25.567861    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.24:6567/health\": dial tcp 10.134.0.24:6567: connect: connection refused"
Sep 17 11:59:25.568316 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:25.567974    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:59:26.221050 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:26.221023    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:26.224010 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:26.223988    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 11:59:28.578501 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:28.578446    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.24:8443: connect: connection refused"
Sep 17 11:59:28.578909 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:28.578638    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:59:32.001940 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.001910    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerID="f4c313d50324fe574d8a4c05e7aba474a3d772cc91fd8d45f6faf957f7633b7e" exitCode=137
Sep 17 11:59:32.001940 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.001936    2571 generic.go:356] "Generic (PLEG): container finished" podID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerID="d1b8df83d954f22fe7b5f5bd336519c6b40d090569c90b1aceb1c1da190d24ed" exitCode=137
Sep 17 11:59:32.002285 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.001979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"f4c313d50324fe574d8a4c05e7aba474a3d772cc91fd8d45f6faf957f7633b7e"}
Sep 17 11:59:32.002285 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.002019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"d1b8df83d954f22fe7b5f5bd336519c6b40d090569c90b1aceb1c1da190d24ed"}
Sep 17 11:59:32.115644 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.115619    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:59:32.204252 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204224    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-online-tls\") pod \"dc2d8837-108b-4ff1-8cd7-7147515f841a\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") "
Sep 17 11:59:32.204382 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204262    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-ui-tls\") pod \"dc2d8837-108b-4ff1-8cd7-7147515f841a\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") "
Sep 17 11:59:32.204382 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204314    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2d8837-108b-4ff1-8cd7-7147515f841a-feast-data\") pod \"dc2d8837-108b-4ff1-8cd7-7147515f841a\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") "
Sep 17 11:59:32.204382 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204360    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls\") pod \"dc2d8837-108b-4ff1-8cd7-7147515f841a\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") "
Sep 17 11:59:32.204530 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204383    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4vkl\" (UniqueName: \"kubernetes.io/projected/dc2d8837-108b-4ff1-8cd7-7147515f841a-kube-api-access-m4vkl\") pod \"dc2d8837-108b-4ff1-8cd7-7147515f841a\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") "
Sep 17 11:59:32.204530 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204434    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-offline-tls\") pod \"dc2d8837-108b-4ff1-8cd7-7147515f841a\" (UID: \"dc2d8837-108b-4ff1-8cd7-7147515f841a\") "
Sep 17 11:59:32.204917 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.204877    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc2d8837-108b-4ff1-8cd7-7147515f841a-feast-data" (OuterVolumeSpecName: "feast-data") pod "dc2d8837-108b-4ff1-8cd7-7147515f841a" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:59:32.206658 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.206631    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "dc2d8837-108b-4ff1-8cd7-7147515f841a" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:59:32.206803 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.206784    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2d8837-108b-4ff1-8cd7-7147515f841a-kube-api-access-m4vkl" (OuterVolumeSpecName: "kube-api-access-m4vkl") pod "dc2d8837-108b-4ff1-8cd7-7147515f841a" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a"). InnerVolumeSpecName "kube-api-access-m4vkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:59:32.207042 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.207012    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "dc2d8837-108b-4ff1-8cd7-7147515f841a" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:59:32.207146 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.207115    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-online-tls" (OuterVolumeSpecName: "online-tls") pod "dc2d8837-108b-4ff1-8cd7-7147515f841a" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:59:32.207239 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.207163    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dc2d8837-108b-4ff1-8cd7-7147515f841a" (UID: "dc2d8837-108b-4ff1-8cd7-7147515f841a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:59:32.305489 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.305438    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2d8837-108b-4ff1-8cd7-7147515f841a-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:59:32.305489 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.305458    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:59:32.305489 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.305468    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4vkl\" (UniqueName: \"kubernetes.io/projected/dc2d8837-108b-4ff1-8cd7-7147515f841a-kube-api-access-m4vkl\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:59:32.305489 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.305477    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:59:32.305489 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.305486    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:59:32.305712 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:32.305494    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/dc2d8837-108b-4ff1-8cd7-7147515f841a-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 11:59:33.010122 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.010099    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"
Sep 17 11:59:33.010536 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.010099    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj" event={"ID":"dc2d8837-108b-4ff1-8cd7-7147515f841a","Type":"ContainerDied","Data":"909378b9f88c24ca25e693f46be180b213a3714d4d6366702bd4cc473baedd27"}
Sep 17 11:59:33.010536 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.010227    2571 scope.go:117] "RemoveContainer" containerID="d905aed185cc23060eaf93791f012065664f085730434220a5820083739371bf"
Sep 17 11:59:33.020004 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.019990    2571 scope.go:117] "RemoveContainer" containerID="f4c313d50324fe574d8a4c05e7aba474a3d772cc91fd8d45f6faf957f7633b7e"
Sep 17 11:59:33.028191 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.028175    2571 scope.go:117] "RemoveContainer" containerID="a97b6944a28bd8c3682bbb186bec530b1b611bcd2456f239a2ecde02f5333bfc"
Sep 17 11:59:33.035626 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.035607    2571 scope.go:117] "RemoveContainer" containerID="d1b8df83d954f22fe7b5f5bd336519c6b40d090569c90b1aceb1c1da190d24ed"
Sep 17 11:59:33.042937 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.042920    2571 scope.go:117] "RemoveContainer" containerID="43f12f634ae20e8a114368944da6c42a57c207ae8a15e6959722f61bf16508b1"
Sep 17 11:59:33.050456 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.050435    2571 scope.go:117] "RemoveContainer" containerID="28d54f902c3d60eef2b0b01047881e4b3ee5f45587c895a183547c2584d43b90"
Sep 17 11:59:33.050628 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.050610    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"]
Sep 17 11:59:33.062843 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.062822    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-tw9wj"]
Sep 17 11:59:33.834385 ip-10-0-142-23 kubenswrapper[2571]: I0917 11:59:33.834347    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" path="/var/lib/kubelet/pods/dc2d8837-108b-4ff1-8cd7-7147515f841a/volumes"
Sep 17 12:00:29.264750 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.264715    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"]
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265026    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265037    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265044    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="offline"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265050    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="offline"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265058    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="feast-init"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265065    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="feast-init"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265071    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265076    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265088    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265092    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265101    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="feast-apply"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265106    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="feast-apply"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265173    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="online"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265181    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="registry"
Sep 17 12:00:29.265184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265189    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="offline"
Sep 17 12:00:29.265680 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.265194    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2d8837-108b-4ff1-8cd7-7147515f841a" containerName="ui"
Sep 17 12:00:29.269562 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.269542    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.277006 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.276986    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 12:00:29.277136 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.277115    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 12:00:29.277375 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.277356    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 12:00:29.278539 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.278522    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 17 12:00:29.279727 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.279711    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-online-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.279803 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.279738    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-ui-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.279803 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.279756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6966a1-2158-4ec8-b96a-acbd90f7f680-feast-data\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.279916 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.279890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0e6966a1-2158-4ec8-b96a-acbd90f7f680-registry-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.279971 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.279939    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-offline-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.280022 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.279982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7lnh\" (UniqueName: \"kubernetes.io/projected/0e6966a1-2158-4ec8-b96a-acbd90f7f680-kube-api-access-g7lnh\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.287062 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.287047    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 12:00:29.289515 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.289500    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 12:00:29.313604 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.313578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-6wd4v\""
Sep 17 12:00:29.318513 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.318498    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 12:00:29.380735 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.380710    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7lnh\" (UniqueName: \"kubernetes.io/projected/0e6966a1-2158-4ec8-b96a-acbd90f7f680-kube-api-access-g7lnh\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.380856 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.380787    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-online-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.380856 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.380821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-ui-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.380856 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.380843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6966a1-2158-4ec8-b96a-acbd90f7f680-feast-data\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.381024 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.380897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0e6966a1-2158-4ec8-b96a-acbd90f7f680-registry-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.381024 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.380941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-offline-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.381294 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.381273    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6966a1-2158-4ec8-b96a-acbd90f7f680-feast-data\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.381849 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.381830    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0e6966a1-2158-4ec8-b96a-acbd90f7f680-registry-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.383388 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.383361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-ui-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.383602 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.383583    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-offline-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.383646 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.383591    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-online-tls\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.420078 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.420061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7lnh\" (UniqueName: \"kubernetes.io/projected/0e6966a1-2158-4ec8-b96a-acbd90f7f680-kube-api-access-g7lnh\") pod \"feast-simple-feast-remote-setup-7484d79fdc-7vt54\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.445435 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.445410    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"]
Sep 17 12:00:29.578235 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.578176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:00:29.873502 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:00:29.873475    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e6966a1_2158_4ec8_b96a_acbd90f7f680.slice/crio-fbe7f455ab9b69073b5ebb232565dbeab13152245ae1a727c3e7241e97ed0322 WatchSource:0}: Error finding container fbe7f455ab9b69073b5ebb232565dbeab13152245ae1a727c3e7241e97ed0322: Status 404 returned error can't find the container with id fbe7f455ab9b69073b5ebb232565dbeab13152245ae1a727c3e7241e97ed0322
Sep 17 12:00:29.875112 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:29.875088    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"]
Sep 17 12:00:30.235450 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:30.235411    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerStarted","Data":"d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94"}
Sep 17 12:00:30.235606 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:30.235464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerStarted","Data":"fbe7f455ab9b69073b5ebb232565dbeab13152245ae1a727c3e7241e97ed0322"}
Sep 17 12:00:35.264074 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:35.264042    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerID="d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94" exitCode=0
Sep 17 12:00:35.264451 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:35.264124    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerDied","Data":"d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94"}
Sep 17 12:00:36.270799 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:00:36.270743    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerStarted","Data":"3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab"}
Sep 17 12:01:06.390351 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:06.390324    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerID="3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab" exitCode=0
Sep 17 12:01:06.390666 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:06.390398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerDied","Data":"3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab"}
Sep 17 12:01:07.399729 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:07.399692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerStarted","Data":"4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf"}
Sep 17 12:01:07.400215 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:07.399740    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerStarted","Data":"0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52"}
Sep 17 12:01:07.400215 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:07.399752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerStarted","Data":"29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15"}
Sep 17 12:01:07.433306 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:07.433251    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podStartSLOduration=38.433230785 podStartE2EDuration="38.433230785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:00:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:01:07.431983298 +0000 UTC m=+582.124430845" watchObservedRunningTime="2026-09-17 12:01:07.433230785 +0000 UTC m=+582.125678316"
Sep 17 12:01:08.579057 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:08.579016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:08.579408 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:08.579074    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:08.579408 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:08.579090    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:08.580890 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:08.580855    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
Sep 17 12:01:08.581010 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:08.580908    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Sep 17 12:01:08.581010 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:08.580853    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
Sep 17 12:01:09.579131 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:09.579089    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:09.579503 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:09.579163    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:09.579503 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:09.579185    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:11.579053 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:11.579009    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
Sep 17 12:01:11.579053 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:11.579029    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
Sep 17 12:01:11.579464 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:11.579019    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Sep 17 12:01:14.578925 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:14.578881    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
Sep 17 12:01:14.579729 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:14.579712    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:14.580480 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:14.580461    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:14.606317 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:14.606301    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:15.464733 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:15.464703    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:17.579577 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:17.579546    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:01:18.454931 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:01:18.454899    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:02:21.353751 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.353717    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"]
Sep 17 12:02:21.354251 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.353969    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online" containerID="cri-o://29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15" gracePeriod=30
Sep 17 12:02:21.354251 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.354008    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" containerID="cri-o://4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf" gracePeriod=30
Sep 17 12:02:21.354251 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.354050    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="offline" containerID="cri-o://0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52" gracePeriod=30
Sep 17 12:02:21.475397 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.475366    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"]
Sep 17 12:02:21.475645 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.475620    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="registry" containerID="cri-o://7b65b34de6653bc38cf0550b7ea69d99a15fe0e8a1d0bc5956d3d21181d69a68" gracePeriod=30
Sep 17 12:02:21.475935 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.475747    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="offline" containerID="cri-o://0b85061362ff94305d205e194b2bcab705a14fca1ffbcedd74ce3bb89edbcb27" gracePeriod=30
Sep 17 12:02:21.475935 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.475804    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui" containerID="cri-o://fb787e6460059937b69f293f2b6ccfa4377253bc4503cdd4660cf8b0343037c1" gracePeriod=30
Sep 17 12:02:21.475935 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:21.475824    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" containerID="cri-o://90783f0720d5c9afb6336f3708ec472a551e8a07f850bd8b20a100e68093c959" gracePeriod=30
Sep 17 12:02:22.727753 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.727727    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerID="fb787e6460059937b69f293f2b6ccfa4377253bc4503cdd4660cf8b0343037c1" exitCode=0
Sep 17 12:02:22.727753 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.727751    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerID="90783f0720d5c9afb6336f3708ec472a551e8a07f850bd8b20a100e68093c959" exitCode=0
Sep 17 12:02:22.728169 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.727801    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"fb787e6460059937b69f293f2b6ccfa4377253bc4503cdd4660cf8b0343037c1"}
Sep 17 12:02:22.728169 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.727844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"90783f0720d5c9afb6336f3708ec472a551e8a07f850bd8b20a100e68093c959"}
Sep 17 12:02:22.730573 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.730550    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerID="4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf" exitCode=0
Sep 17 12:02:22.730573 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.730573    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerID="29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15" exitCode=0
Sep 17 12:02:22.730717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.730617    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerDied","Data":"4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf"}
Sep 17 12:02:22.730717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:22.730650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerDied","Data":"29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15"}
Sep 17 12:02:23.217079 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:23.217042    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
Sep 17 12:02:25.441129 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:25.441080    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Sep 17 12:02:26.222425 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:26.222380    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
Sep 17 12:02:28.455557 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:28.455518    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
Sep 17 12:02:33.217503 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:33.217444    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
Sep 17 12:02:35.441245 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:35.441193    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Sep 17 12:02:36.222484 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:36.222446    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
Sep 17 12:02:38.455077 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:38.455026    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
Sep 17 12:02:43.217834 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:43.217762    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.25:8443: connect: connection refused"
Sep 17 12:02:43.218300 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:43.217927    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 12:02:45.440786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:45.440735    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Sep 17 12:02:45.441242 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:45.440877    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:02:46.222236 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:46.222199    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused"
Sep 17 12:02:46.222408 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:46.222297    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 12:02:48.455137 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:48.455091    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.26:8443: connect: connection refused"
Sep 17 12:02:48.455605 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:48.455226    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:02:51.593470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.593446    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:02:51.730897 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.730870    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-offline-tls\") pod \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") "
Sep 17 12:02:51.731036 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.730913    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-online-tls\") pod \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") "
Sep 17 12:02:51.731036 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.730966    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6966a1-2158-4ec8-b96a-acbd90f7f680-feast-data\") pod \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") "
Sep 17 12:02:51.731036 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.731025    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-ui-tls\") pod \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") "
Sep 17 12:02:51.731205 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.731070    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0e6966a1-2158-4ec8-b96a-acbd90f7f680-registry-tls\") pod \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") "
Sep 17 12:02:51.731205 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.731105    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7lnh\" (UniqueName: \"kubernetes.io/projected/0e6966a1-2158-4ec8-b96a-acbd90f7f680-kube-api-access-g7lnh\") pod \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\" (UID: \"0e6966a1-2158-4ec8-b96a-acbd90f7f680\") "
Sep 17 12:02:51.731457 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.731428    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e6966a1-2158-4ec8-b96a-acbd90f7f680-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0e6966a1-2158-4ec8-b96a-acbd90f7f680" (UID: "0e6966a1-2158-4ec8-b96a-acbd90f7f680"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 12:02:51.731559 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.731479    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e6966a1-2158-4ec8-b96a-acbd90f7f680-feast-data" (OuterVolumeSpecName: "feast-data") pod "0e6966a1-2158-4ec8-b96a-acbd90f7f680" (UID: "0e6966a1-2158-4ec8-b96a-acbd90f7f680"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:02:51.733227 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.733203    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0e6966a1-2158-4ec8-b96a-acbd90f7f680" (UID: "0e6966a1-2158-4ec8-b96a-acbd90f7f680"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:51.733486 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.733461    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e6966a1-2158-4ec8-b96a-acbd90f7f680-kube-api-access-g7lnh" (OuterVolumeSpecName: "kube-api-access-g7lnh") pod "0e6966a1-2158-4ec8-b96a-acbd90f7f680" (UID: "0e6966a1-2158-4ec8-b96a-acbd90f7f680"). InnerVolumeSpecName "kube-api-access-g7lnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:02:51.733751 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.733735    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-online-tls" (OuterVolumeSpecName: "online-tls") pod "0e6966a1-2158-4ec8-b96a-acbd90f7f680" (UID: "0e6966a1-2158-4ec8-b96a-acbd90f7f680"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:51.733840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.733752    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0e6966a1-2158-4ec8-b96a-acbd90f7f680" (UID: "0e6966a1-2158-4ec8-b96a-acbd90f7f680"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:51.832118 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.832092    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:51.832118 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.832117    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/0e6966a1-2158-4ec8-b96a-acbd90f7f680-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:51.832262 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.832131    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7lnh\" (UniqueName: \"kubernetes.io/projected/0e6966a1-2158-4ec8-b96a-acbd90f7f680-kube-api-access-g7lnh\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:51.832262 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.832144    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:51.832262 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.832180    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0e6966a1-2158-4ec8-b96a-acbd90f7f680-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:51.832262 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.832191    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0e6966a1-2158-4ec8-b96a-acbd90f7f680-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:51.849725 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.849702    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerID="0b85061362ff94305d205e194b2bcab705a14fca1ffbcedd74ce3bb89edbcb27" exitCode=137
Sep 17 12:02:51.849725 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.849723    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerID="7b65b34de6653bc38cf0550b7ea69d99a15fe0e8a1d0bc5956d3d21181d69a68" exitCode=137
Sep 17 12:02:51.849883 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.849762    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"0b85061362ff94305d205e194b2bcab705a14fca1ffbcedd74ce3bb89edbcb27"}
Sep 17 12:02:51.849883 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.849818    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"7b65b34de6653bc38cf0550b7ea69d99a15fe0e8a1d0bc5956d3d21181d69a68"}
Sep 17 12:02:51.852148 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.852130    2571 generic.go:356] "Generic (PLEG): container finished" podID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerID="0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52" exitCode=137
Sep 17 12:02:51.852237 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.852190    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"
Sep 17 12:02:51.852293 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.852191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerDied","Data":"0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52"}
Sep 17 12:02:51.852346 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.852301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54" event={"ID":"0e6966a1-2158-4ec8-b96a-acbd90f7f680","Type":"ContainerDied","Data":"fbe7f455ab9b69073b5ebb232565dbeab13152245ae1a727c3e7241e97ed0322"}
Sep 17 12:02:51.852346 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.852330    2571 scope.go:117] "RemoveContainer" containerID="4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf"
Sep 17 12:02:51.860350 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.860331    2571 scope.go:117] "RemoveContainer" containerID="0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52"
Sep 17 12:02:51.867927 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.867912    2571 scope.go:117] "RemoveContainer" containerID="29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15"
Sep 17 12:02:51.875115 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.875102    2571 scope.go:117] "RemoveContainer" containerID="3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab"
Sep 17 12:02:51.887100 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.887079    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"]
Sep 17 12:02:51.888156 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.888140    2571 scope.go:117] "RemoveContainer" containerID="d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94"
Sep 17 12:02:51.897836 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.897816    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7484d79fdc-7vt54"]
Sep 17 12:02:51.898470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.898455    2571 scope.go:117] "RemoveContainer" containerID="4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf"
Sep 17 12:02:51.898728 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:02:51.898708    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf\": container with ID starting with 4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf not found: ID does not exist" containerID="4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf"
Sep 17 12:02:51.898849 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.898735    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf"} err="failed to get container status \"4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf\": rpc error: code = NotFound desc = could not find container \"4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf\": container with ID starting with 4e20987ab4610f11a85b11b1129b0c4d15e664687b0560e235c27e5f5a9207bf not found: ID does not exist"
Sep 17 12:02:51.898849 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.898753    2571 scope.go:117] "RemoveContainer" containerID="0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52"
Sep 17 12:02:51.899001 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:02:51.898987    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52\": container with ID starting with 0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52 not found: ID does not exist" containerID="0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52"
Sep 17 12:02:51.899044 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899004    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52"} err="failed to get container status \"0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52\": rpc error: code = NotFound desc = could not find container \"0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52\": container with ID starting with 0e746c395fc7b1b4560c5c75af8eb67a97bc6338652b5545cd2fd0f5905b8c52 not found: ID does not exist"
Sep 17 12:02:51.899044 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899018    2571 scope.go:117] "RemoveContainer" containerID="29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15"
Sep 17 12:02:51.899222 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:02:51.899207    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15\": container with ID starting with 29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15 not found: ID does not exist" containerID="29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15"
Sep 17 12:02:51.899261 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899225    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15"} err="failed to get container status \"29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15\": rpc error: code = NotFound desc = could not find container \"29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15\": container with ID starting with 29dcb20d302936b3c791fd6ebaf1823eadb07fe028023f4bbc2f42beb7984d15 not found: ID does not exist"
Sep 17 12:02:51.899261 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899238    2571 scope.go:117] "RemoveContainer" containerID="3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab"
Sep 17 12:02:51.899468 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:02:51.899451    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab\": container with ID starting with 3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab not found: ID does not exist" containerID="3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab"
Sep 17 12:02:51.899529 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899475    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab"} err="failed to get container status \"3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab\": rpc error: code = NotFound desc = could not find container \"3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab\": container with ID starting with 3cfbad91c3549ee6d8d82bd4732148dfef8bd702550a7b7b570ceecc4fb64fab not found: ID does not exist"
Sep 17 12:02:51.899529 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899496    2571 scope.go:117] "RemoveContainer" containerID="d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94"
Sep 17 12:02:51.899739 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:02:51.899724    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94\": container with ID starting with d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94 not found: ID does not exist" containerID="d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94"
Sep 17 12:02:51.899802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:51.899743    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94"} err="failed to get container status \"d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94\": rpc error: code = NotFound desc = could not find container \"d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94\": container with ID starting with d7c8ae440d65235c2b4ebcd18e73dfe8c4cc79be46c38f92130deaca2df12f94 not found: ID does not exist"
Sep 17 12:02:52.117742 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.117720    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 12:02:52.235462 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.235440    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-registry-tls\") pod \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") "
Sep 17 12:02:52.235615 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.235473    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5tsh\" (UniqueName: \"kubernetes.io/projected/fb56e5e0-b344-4999-93f0-a90c396e1fe1-kube-api-access-h5tsh\") pod \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") "
Sep 17 12:02:52.235615 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.235527    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-offline-tls\") pod \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") "
Sep 17 12:02:52.235615 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.235554    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56e5e0-b344-4999-93f0-a90c396e1fe1-feast-data\") pod \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") "
Sep 17 12:02:52.235615 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.235588    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-ui-tls\") pod \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") "
Sep 17 12:02:52.235615 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.235609    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-online-tls\") pod \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\" (UID: \"fb56e5e0-b344-4999-93f0-a90c396e1fe1\") "
Sep 17 12:02:52.236475 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.236158    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb56e5e0-b344-4999-93f0-a90c396e1fe1-feast-data" (OuterVolumeSpecName: "feast-data") pod "fb56e5e0-b344-4999-93f0-a90c396e1fe1" (UID: "fb56e5e0-b344-4999-93f0-a90c396e1fe1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:02:52.237924 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.237894    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fb56e5e0-b344-4999-93f0-a90c396e1fe1" (UID: "fb56e5e0-b344-4999-93f0-a90c396e1fe1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:52.238043 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.237963    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb56e5e0-b344-4999-93f0-a90c396e1fe1-kube-api-access-h5tsh" (OuterVolumeSpecName: "kube-api-access-h5tsh") pod "fb56e5e0-b344-4999-93f0-a90c396e1fe1" (UID: "fb56e5e0-b344-4999-93f0-a90c396e1fe1"). InnerVolumeSpecName "kube-api-access-h5tsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:02:52.238043 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.237961    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "fb56e5e0-b344-4999-93f0-a90c396e1fe1" (UID: "fb56e5e0-b344-4999-93f0-a90c396e1fe1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:52.238295 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.238276    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "fb56e5e0-b344-4999-93f0-a90c396e1fe1" (UID: "fb56e5e0-b344-4999-93f0-a90c396e1fe1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:52.238354 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.238294    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-online-tls" (OuterVolumeSpecName: "online-tls") pod "fb56e5e0-b344-4999-93f0-a90c396e1fe1" (UID: "fb56e5e0-b344-4999-93f0-a90c396e1fe1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:02:52.336866 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.336806    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:52.336866 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.336829    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fb56e5e0-b344-4999-93f0-a90c396e1fe1-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:52.336866 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.336842    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:52.336866 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.336852    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:52.336866 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.336863    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fb56e5e0-b344-4999-93f0-a90c396e1fe1-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:52.337064 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.336875    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5tsh\" (UniqueName: \"kubernetes.io/projected/fb56e5e0-b344-4999-93f0-a90c396e1fe1-kube-api-access-h5tsh\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:02:52.859362 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.859336    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"
Sep 17 12:02:52.859362 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.859354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2" event={"ID":"fb56e5e0-b344-4999-93f0-a90c396e1fe1","Type":"ContainerDied","Data":"4ce9bf2ae83b3e0a00bbccd89015e3943b186b843cac6fe227c0eed87b223a42"}
Sep 17 12:02:52.859874 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.859390    2571 scope.go:117] "RemoveContainer" containerID="fb787e6460059937b69f293f2b6ccfa4377253bc4503cdd4660cf8b0343037c1"
Sep 17 12:02:52.867797 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.867749    2571 scope.go:117] "RemoveContainer" containerID="0b85061362ff94305d205e194b2bcab705a14fca1ffbcedd74ce3bb89edbcb27"
Sep 17 12:02:52.875762 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.875744    2571 scope.go:117] "RemoveContainer" containerID="90783f0720d5c9afb6336f3708ec472a551e8a07f850bd8b20a100e68093c959"
Sep 17 12:02:52.882963 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.882946    2571 scope.go:117] "RemoveContainer" containerID="7b65b34de6653bc38cf0550b7ea69d99a15fe0e8a1d0bc5956d3d21181d69a68"
Sep 17 12:02:52.887327 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.887308    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"]
Sep 17 12:02:52.890576 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.890558    2571 scope.go:117] "RemoveContainer" containerID="3b453c6deca870c27659bd6dc656edf65d3af9796df696b34f76254173e94f8f"
Sep 17 12:02:52.892699 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.892682    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-665f95d49f-g7zc2"]
Sep 17 12:02:52.897717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:52.897695    2571 scope.go:117] "RemoveContainer" containerID="63a4009ea02a1875b0158dfa94b811efa6dfcaedf1cdb3ab2d86dd088ff9494f"
Sep 17 12:02:53.833201 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:53.833171    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" path="/var/lib/kubelet/pods/0e6966a1-2158-4ec8-b96a-acbd90f7f680/volumes"
Sep 17 12:02:53.833781 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:02:53.833750    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" path="/var/lib/kubelet/pods/fb56e5e0-b344-4999-93f0-a90c396e1fe1/volumes"
Sep 17 12:03:02.607472 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607443    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-5xnjl"]
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607713    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="offline"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607724    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="offline"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607738    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="feast-init"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607744    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="feast-init"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607751    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="feast-apply"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607756    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="feast-apply"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607762    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="feast-apply"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607783    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="feast-apply"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607789    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="registry"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607794    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="registry"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607799    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607804    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607813    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607819    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607825    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="feast-init"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607830    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="feast-init"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607840    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online"
Sep 17 12:03:02.607840 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607845    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607852    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607857    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607863    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="offline"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607867    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="offline"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607929    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="registry"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607937    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="offline"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607941    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="online"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607947    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb56e5e0-b344-4999-93f0-a90c396e1fe1" containerName="ui"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607953    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="offline"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607957    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="ui"
Sep 17 12:03:02.608357 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.607962    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e6966a1-2158-4ec8-b96a-acbd90f7f680" containerName="online"
Sep 17 12:03:02.612613 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.612597    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.619634 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.619613    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 12:03:02.619731 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.619613    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 17 12:03:02.619810 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.619616    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 12:03:02.620437 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.620423    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-nncwt\""
Sep 17 12:03:02.635567 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.635544    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-5xnjl"]
Sep 17 12:03:02.710459 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.710430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cc78\" (UniqueName: \"kubernetes.io/projected/5c35b416-d87a-474f-a8e5-482fde2b9235-kube-api-access-7cc78\") pod \"postgres-864846d4f5-5xnjl\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") " pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.710584 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.710476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5c35b416-d87a-474f-a8e5-482fde2b9235-postgresdata\") pod \"postgres-864846d4f5-5xnjl\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") " pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.811099 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.811064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cc78\" (UniqueName: \"kubernetes.io/projected/5c35b416-d87a-474f-a8e5-482fde2b9235-kube-api-access-7cc78\") pod \"postgres-864846d4f5-5xnjl\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") " pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.811275 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.811117    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5c35b416-d87a-474f-a8e5-482fde2b9235-postgresdata\") pod \"postgres-864846d4f5-5xnjl\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") " pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.811420 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.811405    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5c35b416-d87a-474f-a8e5-482fde2b9235-postgresdata\") pod \"postgres-864846d4f5-5xnjl\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") " pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.821703 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.821681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cc78\" (UniqueName: \"kubernetes.io/projected/5c35b416-d87a-474f-a8e5-482fde2b9235-kube-api-access-7cc78\") pod \"postgres-864846d4f5-5xnjl\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") " pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:02.930928 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:02.930871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:03:03.223735 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:03.223706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-5xnjl"]
Sep 17 12:03:03.228005 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:03:03.227979    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c35b416_d87a_474f_a8e5_482fde2b9235.slice/crio-0a365e2f15e318bf3ab5ba6059b48e203543236c8c75b193aff21b204e317184 WatchSource:0}: Error finding container 0a365e2f15e318bf3ab5ba6059b48e203543236c8c75b193aff21b204e317184: Status 404 returned error can't find the container with id 0a365e2f15e318bf3ab5ba6059b48e203543236c8c75b193aff21b204e317184
Sep 17 12:03:03.229627 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:03.229610    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 12:03:03.904116 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:03.904085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-5xnjl" event={"ID":"5c35b416-d87a-474f-a8e5-482fde2b9235","Type":"ContainerStarted","Data":"0a365e2f15e318bf3ab5ba6059b48e203543236c8c75b193aff21b204e317184"}
Sep 17 12:03:09.929052 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:09.928972    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-5xnjl" event={"ID":"5c35b416-d87a-474f-a8e5-482fde2b9235","Type":"ContainerStarted","Data":"ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195"}
Sep 17 12:03:09.970115 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:09.970052    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-5xnjl" podStartSLOduration=1.584609519 podStartE2EDuration="7.97003154s" totalImagesPullingTime="6.385422021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:03:09.96907834 +0000 UTC m=+704.661525871" watchObservedRunningTime="2026-09-17 12:03:09.97003154 +0000 UTC m=+704.662479074"
Sep 17 12:03:13.529867 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.529833    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"]
Sep 17 12:03:13.535048 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.535027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.538760 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.538741    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 17 12:03:13.538976 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.538952    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-x72r5\""
Sep 17 12:03:13.539063 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.539019    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 17 12:03:13.539212 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.539192    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 17 12:03:13.539212 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.539222    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 17 12:03:13.559010 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.558987    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"]
Sep 17 12:03:13.594680 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.594652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-registry-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.594803 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.594730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.594803 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.594758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w54l\" (UniqueName: \"kubernetes.io/projected/46206d12-ca99-47f7-9287-98301290e744-kube-api-access-8w54l\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.594923 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.594804    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/46206d12-ca99-47f7-9287-98301290e744-feast-data\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.594923 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.594836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.695169 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.695147    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-registry-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.695275 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.695199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.695275 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.695215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w54l\" (UniqueName: \"kubernetes.io/projected/46206d12-ca99-47f7-9287-98301290e744-kube-api-access-8w54l\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.695275 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.695238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/46206d12-ca99-47f7-9287-98301290e744-feast-data\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.695275 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.695270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.695487 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:03:13.695316    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found
Sep 17 12:03:13.695487 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:03:13.695350    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 17 12:03:13.695487 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:03:13.695387    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls podName:46206d12-ca99-47f7-9287-98301290e744 nodeName:}" failed. No retries permitted until 2026-09-17 12:03:14.195365437 +0000 UTC m=+708.887812962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls") pod "feast-credit-scoring-6476f496f8-s69zb" (UID: "46206d12-ca99-47f7-9287-98301290e744") : secret "feast-credit-scoring-offline-tls" not found
Sep 17 12:03:13.695487 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:03:13.695406    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls podName:46206d12-ca99-47f7-9287-98301290e744 nodeName:}" failed. No retries permitted until 2026-09-17 12:03:14.195397378 +0000 UTC m=+708.887844887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls") pod "feast-credit-scoring-6476f496f8-s69zb" (UID: "46206d12-ca99-47f7-9287-98301290e744") : secret "feast-credit-scoring-online-tls" not found
Sep 17 12:03:13.695672 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.695649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/46206d12-ca99-47f7-9287-98301290e744-feast-data\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.697729 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.697712    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-registry-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:13.705916 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:13.705893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w54l\" (UniqueName: \"kubernetes.io/projected/46206d12-ca99-47f7-9287-98301290e744-kube-api-access-8w54l\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:14.198733 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.198705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:14.198898 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.198793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:14.201131 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.201101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:14.201247 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.201139    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls\") pod \"feast-credit-scoring-6476f496f8-s69zb\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") " pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:14.446898 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.446864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:14.738893 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.738869    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"]
Sep 17 12:03:14.741337 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:03:14.741309    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46206d12_ca99_47f7_9287_98301290e744.slice/crio-15b05087bdcb18c5d9ec3f6c33f7298b34a48475ae3b596dfde50c14e678709b WatchSource:0}: Error finding container 15b05087bdcb18c5d9ec3f6c33f7298b34a48475ae3b596dfde50c14e678709b: Status 404 returned error can't find the container with id 15b05087bdcb18c5d9ec3f6c33f7298b34a48475ae3b596dfde50c14e678709b
Sep 17 12:03:14.948522 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.948492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerStarted","Data":"60a84dbdf835ddd5c16e0a01c078a77ab6be07ecb7b7e92e0ea7d36d4a6bf831"}
Sep 17 12:03:14.948625 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:14.948545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerStarted","Data":"15b05087bdcb18c5d9ec3f6c33f7298b34a48475ae3b596dfde50c14e678709b"}
Sep 17 12:03:15.953333 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:15.953303    2571 generic.go:356] "Generic (PLEG): container finished" podID="46206d12-ca99-47f7-9287-98301290e744" containerID="60a84dbdf835ddd5c16e0a01c078a77ab6be07ecb7b7e92e0ea7d36d4a6bf831" exitCode=0
Sep 17 12:03:15.953640 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:15.953388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerDied","Data":"60a84dbdf835ddd5c16e0a01c078a77ab6be07ecb7b7e92e0ea7d36d4a6bf831"}
Sep 17 12:03:16.959654 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:16.959614    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerStarted","Data":"918914bea4d91144830a453101d6c97b273949ecc30701e91d0b3646c17c9d8a"}
Sep 17 12:03:23.989381 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:23.989346    2571 generic.go:356] "Generic (PLEG): container finished" podID="46206d12-ca99-47f7-9287-98301290e744" containerID="918914bea4d91144830a453101d6c97b273949ecc30701e91d0b3646c17c9d8a" exitCode=0
Sep 17 12:03:23.989738 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:23.989400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerDied","Data":"918914bea4d91144830a453101d6c97b273949ecc30701e91d0b3646c17c9d8a"}
Sep 17 12:03:24.997588 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:24.997555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerStarted","Data":"489a205902bd5337a2b6699aa1eb6c421551716bb0238be447b3061cd3fd5b36"}
Sep 17 12:03:24.998065 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:24.997621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerStarted","Data":"c29d071f8b1182179d6f47ef639e69d7e4a6ccbc1848474fc376e8b8f653826f"}
Sep 17 12:03:24.998065 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:24.997646    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerStarted","Data":"a8b271319b6f14ef392a16ee99cf11d42c2db9347b3e92880047e12704721da6"}
Sep 17 12:03:25.031317 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:25.031258    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podStartSLOduration=12.031235398 podStartE2EDuration="12.031235398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:03:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:03:25.030792559 +0000 UTC m=+719.723240091" watchObservedRunningTime="2026-09-17 12:03:25.031235398 +0000 UTC m=+719.723683139"
Sep 17 12:03:26.447732 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:26.447696    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:26.448212 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:26.447845    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:26.448212 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:26.447875    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:26.449477 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:26.449443    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused"
Sep 17 12:03:26.449619 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:26.449476    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
Sep 17 12:03:26.449619 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:26.449466    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
Sep 17 12:03:29.447437 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:29.447398    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
Sep 17 12:03:29.447933 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:29.447399    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.28:8816: connect: connection refused"
Sep 17 12:03:29.447933 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:29.447893    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
Sep 17 12:03:32.447965 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:32.447910    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
Sep 17 12:03:32.448415 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:32.447962    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
Sep 17 12:03:32.449010 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:32.448985    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:32.449599 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:32.449571    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:32.449940 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:32.449920    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:34.448009 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:34.447965    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:34.448389 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:34.448063    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:35.448105 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:35.448051    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused"
Sep 17 12:03:35.454004 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:35.453970    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:36.057592 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:36.057562    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:38.447944 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:38.447916    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:03:39.067824 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:03:39.067787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:04:47.961852 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:47.961759    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"]
Sep 17 12:04:47.962411 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:47.962071    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry" containerID="cri-o://a8b271319b6f14ef392a16ee99cf11d42c2db9347b3e92880047e12704721da6" gracePeriod=30
Sep 17 12:04:47.962411 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:47.962092    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" containerID="cri-o://c29d071f8b1182179d6f47ef639e69d7e4a6ccbc1848474fc376e8b8f653826f" gracePeriod=30
Sep 17 12:04:47.962411 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:47.962080    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="offline" containerID="cri-o://489a205902bd5337a2b6699aa1eb6c421551716bb0238be447b3061cd3fd5b36" gracePeriod=30
Sep 17 12:04:47.989341 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:47.989309    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-5xnjl"]
Sep 17 12:04:47.989496 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:47.989477    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-5xnjl" podUID="5c35b416-d87a-474f-a8e5-482fde2b9235" containerName="postgres" containerID="cri-o://ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195" gracePeriod=30
Sep 17 12:04:48.236129 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.236104    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:04:48.326001 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.325973    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cc78\" (UniqueName: \"kubernetes.io/projected/5c35b416-d87a-474f-a8e5-482fde2b9235-kube-api-access-7cc78\") pod \"5c35b416-d87a-474f-a8e5-482fde2b9235\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") "
Sep 17 12:04:48.326185 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.326068    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5c35b416-d87a-474f-a8e5-482fde2b9235-postgresdata\") pod \"5c35b416-d87a-474f-a8e5-482fde2b9235\" (UID: \"5c35b416-d87a-474f-a8e5-482fde2b9235\") "
Sep 17 12:04:48.328240 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.328206    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c35b416-d87a-474f-a8e5-482fde2b9235-kube-api-access-7cc78" (OuterVolumeSpecName: "kube-api-access-7cc78") pod "5c35b416-d87a-474f-a8e5-482fde2b9235" (UID: "5c35b416-d87a-474f-a8e5-482fde2b9235"). InnerVolumeSpecName "kube-api-access-7cc78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:04:48.356306 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.356276    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c35b416-d87a-474f-a8e5-482fde2b9235-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "5c35b416-d87a-474f-a8e5-482fde2b9235" (UID: "5c35b416-d87a-474f-a8e5-482fde2b9235"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:04:48.361896 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.361863    2571 generic.go:356] "Generic (PLEG): container finished" podID="5c35b416-d87a-474f-a8e5-482fde2b9235" containerID="ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195" exitCode=0
Sep 17 12:04:48.362014 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.361911    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-5xnjl"
Sep 17 12:04:48.362014 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.361949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-5xnjl" event={"ID":"5c35b416-d87a-474f-a8e5-482fde2b9235","Type":"ContainerDied","Data":"ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195"}
Sep 17 12:04:48.362014 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.361992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-5xnjl" event={"ID":"5c35b416-d87a-474f-a8e5-482fde2b9235","Type":"ContainerDied","Data":"0a365e2f15e318bf3ab5ba6059b48e203543236c8c75b193aff21b204e317184"}
Sep 17 12:04:48.362014 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.362010    2571 scope.go:117] "RemoveContainer" containerID="ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195"
Sep 17 12:04:48.370707 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.370685    2571 scope.go:117] "RemoveContainer" containerID="ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195"
Sep 17 12:04:48.371021 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:04:48.370994    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195\": container with ID starting with ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195 not found: ID does not exist" containerID="ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195"
Sep 17 12:04:48.371084 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.371021    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195"} err="failed to get container status \"ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195\": rpc error: code = NotFound desc = could not find container \"ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195\": container with ID starting with ce572e9b0d153ee09c5c2bdea1d4d0cc171555b361cb1c702953deacf895b195 not found: ID does not exist"
Sep 17 12:04:48.387595 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.387573    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-5xnjl"]
Sep 17 12:04:48.395078 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.395055    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-5xnjl"]
Sep 17 12:04:48.427300 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.427272    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cc78\" (UniqueName: \"kubernetes.io/projected/5c35b416-d87a-474f-a8e5-482fde2b9235-kube-api-access-7cc78\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:04:48.427300 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:48.427296    2571 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5c35b416-d87a-474f-a8e5-482fde2b9235-postgresdata\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:04:49.368968 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:49.368943    2571 generic.go:356] "Generic (PLEG): container finished" podID="46206d12-ca99-47f7-9287-98301290e744" containerID="c29d071f8b1182179d6f47ef639e69d7e4a6ccbc1848474fc376e8b8f653826f" exitCode=0
Sep 17 12:04:49.369342 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:49.368991    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerDied","Data":"c29d071f8b1182179d6f47ef639e69d7e4a6ccbc1848474fc376e8b8f653826f"}
Sep 17 12:04:49.832480 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:49.832447    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c35b416-d87a-474f-a8e5-482fde2b9235" path="/var/lib/kubelet/pods/5c35b416-d87a-474f-a8e5-482fde2b9235/volumes"
Sep 17 12:04:56.054957 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:04:56.054916    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
Sep 17 12:05:06.055396 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:06.055360    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
Sep 17 12:05:16.054394 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:16.054356    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused"
Sep 17 12:05:16.054796 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:16.054463    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:05:18.019304 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:05:18.019266    2571 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46206d12_ca99_47f7_9287_98301290e744.slice/crio-489a205902bd5337a2b6699aa1eb6c421551716bb0238be447b3061cd3fd5b36.scope\": RecentStats: unable to find data in memory cache]"
Sep 17 12:05:18.484157 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.484129    2571 generic.go:356] "Generic (PLEG): container finished" podID="46206d12-ca99-47f7-9287-98301290e744" containerID="489a205902bd5337a2b6699aa1eb6c421551716bb0238be447b3061cd3fd5b36" exitCode=137
Sep 17 12:05:18.484157 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.484154    2571 generic.go:356] "Generic (PLEG): container finished" podID="46206d12-ca99-47f7-9287-98301290e744" containerID="a8b271319b6f14ef392a16ee99cf11d42c2db9347b3e92880047e12704721da6" exitCode=137
Sep 17 12:05:18.484293 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.484206    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerDied","Data":"489a205902bd5337a2b6699aa1eb6c421551716bb0238be447b3061cd3fd5b36"}
Sep 17 12:05:18.484293 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.484288    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerDied","Data":"a8b271319b6f14ef392a16ee99cf11d42c2db9347b3e92880047e12704721da6"}
Sep 17 12:05:18.616330 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.616308    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:05:18.747217 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.747140    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-registry-tls\") pod \"46206d12-ca99-47f7-9287-98301290e744\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") "
Sep 17 12:05:18.747217 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.747206    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls\") pod \"46206d12-ca99-47f7-9287-98301290e744\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") "
Sep 17 12:05:18.747217 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.747225    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls\") pod \"46206d12-ca99-47f7-9287-98301290e744\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") "
Sep 17 12:05:18.747452 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.747248    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w54l\" (UniqueName: \"kubernetes.io/projected/46206d12-ca99-47f7-9287-98301290e744-kube-api-access-8w54l\") pod \"46206d12-ca99-47f7-9287-98301290e744\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") "
Sep 17 12:05:18.747452 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.747272    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/46206d12-ca99-47f7-9287-98301290e744-feast-data\") pod \"46206d12-ca99-47f7-9287-98301290e744\" (UID: \"46206d12-ca99-47f7-9287-98301290e744\") "
Sep 17 12:05:18.749466 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.749436    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls" (OuterVolumeSpecName: "online-tls") pod "46206d12-ca99-47f7-9287-98301290e744" (UID: "46206d12-ca99-47f7-9287-98301290e744"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:05:18.749563 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.749488    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "46206d12-ca99-47f7-9287-98301290e744" (UID: "46206d12-ca99-47f7-9287-98301290e744"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:05:18.749972 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.749948    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "46206d12-ca99-47f7-9287-98301290e744" (UID: "46206d12-ca99-47f7-9287-98301290e744"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:05:18.750074 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.749981    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46206d12-ca99-47f7-9287-98301290e744-kube-api-access-8w54l" (OuterVolumeSpecName: "kube-api-access-8w54l") pod "46206d12-ca99-47f7-9287-98301290e744" (UID: "46206d12-ca99-47f7-9287-98301290e744"). InnerVolumeSpecName "kube-api-access-8w54l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:05:18.755384 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.755362    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46206d12-ca99-47f7-9287-98301290e744-feast-data" (OuterVolumeSpecName: "feast-data") pod "46206d12-ca99-47f7-9287-98301290e744" (UID: "46206d12-ca99-47f7-9287-98301290e744"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:05:18.848349 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.848326    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:05:18.848349 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.848347    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:05:18.848470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.848356    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/46206d12-ca99-47f7-9287-98301290e744-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:05:18.848470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.848366    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w54l\" (UniqueName: \"kubernetes.io/projected/46206d12-ca99-47f7-9287-98301290e744-kube-api-access-8w54l\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:05:18.848470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:18.848375    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/46206d12-ca99-47f7-9287-98301290e744-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:05:19.492044 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.492014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb" event={"ID":"46206d12-ca99-47f7-9287-98301290e744","Type":"ContainerDied","Data":"15b05087bdcb18c5d9ec3f6c33f7298b34a48475ae3b596dfde50c14e678709b"}
Sep 17 12:05:19.492604 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.492051    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"
Sep 17 12:05:19.492604 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.492085    2571 scope.go:117] "RemoveContainer" containerID="489a205902bd5337a2b6699aa1eb6c421551716bb0238be447b3061cd3fd5b36"
Sep 17 12:05:19.501717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.501699    2571 scope.go:117] "RemoveContainer" containerID="c29d071f8b1182179d6f47ef639e69d7e4a6ccbc1848474fc376e8b8f653826f"
Sep 17 12:05:19.515852 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.515832    2571 scope.go:117] "RemoveContainer" containerID="a8b271319b6f14ef392a16ee99cf11d42c2db9347b3e92880047e12704721da6"
Sep 17 12:05:19.518931 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.518909    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"]
Sep 17 12:05:19.525117 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.525028    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6476f496f8-s69zb"]
Sep 17 12:05:19.525183 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.525167    2571 scope.go:117] "RemoveContainer" containerID="918914bea4d91144830a453101d6c97b273949ecc30701e91d0b3646c17c9d8a"
Sep 17 12:05:19.532820 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.532806    2571 scope.go:117] "RemoveContainer" containerID="60a84dbdf835ddd5c16e0a01c078a77ab6be07ecb7b7e92e0ea7d36d4a6bf831"
Sep 17 12:05:19.832969 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:05:19.832906    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46206d12-ca99-47f7-9287-98301290e744" path="/var/lib/kubelet/pods/46206d12-ca99-47f7-9287-98301290e744/volumes"
Sep 17 12:08:19.922454 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922429    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-p4txw"]
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922728    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="feast-init"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922740    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="feast-init"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922750    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922756    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922783    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="feast-apply"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922790    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="feast-apply"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922799    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922804    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922809    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="offline"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922815    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="offline"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922826    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c35b416-d87a-474f-a8e5-482fde2b9235" containerName="postgres"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922831    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c35b416-d87a-474f-a8e5-482fde2b9235" containerName="postgres"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922886    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c35b416-d87a-474f-a8e5-482fde2b9235" containerName="postgres"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922894    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="offline"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922899    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="registry"
Sep 17 12:08:19.924863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.922908    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="46206d12-ca99-47f7-9287-98301290e744" containerName="online"
Sep 17 12:08:19.925710 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.925696    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:08:19.928229 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.928206    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 17 12:08:19.929172 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.929134    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-xdv45\""
Sep 17 12:08:19.929172 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.929155    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 17 12:08:19.940303 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:19.940278    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-p4txw"]
Sep 17 12:08:20.004181 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:20.004158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqgn7\" (UniqueName: \"kubernetes.io/projected/0d42b2b3-688c-4d15-bf66-6534e5940d80-kube-api-access-kqgn7\") pod \"redis-69bbd798b6-p4txw\" (UID: \"0d42b2b3-688c-4d15-bf66-6534e5940d80\") " pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:08:20.105061 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:20.105033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqgn7\" (UniqueName: \"kubernetes.io/projected/0d42b2b3-688c-4d15-bf66-6534e5940d80-kube-api-access-kqgn7\") pod \"redis-69bbd798b6-p4txw\" (UID: \"0d42b2b3-688c-4d15-bf66-6534e5940d80\") " pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:08:20.115068 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:20.115039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqgn7\" (UniqueName: \"kubernetes.io/projected/0d42b2b3-688c-4d15-bf66-6534e5940d80-kube-api-access-kqgn7\") pod \"redis-69bbd798b6-p4txw\" (UID: \"0d42b2b3-688c-4d15-bf66-6534e5940d80\") " pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:08:20.244647 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:20.244629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:08:20.512037 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:20.512014    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-p4txw"]
Sep 17 12:08:20.514616 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:08:20.514592    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d42b2b3_688c_4d15_bf66_6534e5940d80.slice/crio-e9e7f005e43a04538a15881ef886adb3e886d5f0491be3296358da5ceb20fcb8 WatchSource:0}: Error finding container e9e7f005e43a04538a15881ef886adb3e886d5f0491be3296358da5ceb20fcb8: Status 404 returned error can't find the container with id e9e7f005e43a04538a15881ef886adb3e886d5f0491be3296358da5ceb20fcb8
Sep 17 12:08:20.516518 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:20.516500    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 12:08:21.206351 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:21.206310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw" event={"ID":"0d42b2b3-688c-4d15-bf66-6534e5940d80","Type":"ContainerStarted","Data":"e9e7f005e43a04538a15881ef886adb3e886d5f0491be3296358da5ceb20fcb8"}
Sep 17 12:08:22.211494 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:22.211432    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw" event={"ID":"0d42b2b3-688c-4d15-bf66-6534e5940d80","Type":"ContainerStarted","Data":"5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62"}
Sep 17 12:08:22.236268 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:22.236221    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw" podStartSLOduration=1.798603301 podStartE2EDuration="3.236203564s" totalImagesPullingTime="1.437600263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:08:22.236198729 +0000 UTC m=+1016.928646259" watchObservedRunningTime="2026-09-17 12:08:22.236203564 +0000 UTC m=+1016.928651094"
Sep 17 12:08:25.356188 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.356152    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-vscb9"]
Sep 17 12:08:25.359553 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.359533    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.362042 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.362017    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 17 12:08:25.368621 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.368595    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-vscb9"]
Sep 17 12:08:25.445305 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.445283    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cngf\" (UniqueName: \"kubernetes.io/projected/5855f677-cf8e-4318-a1ba-4addf0569242-kube-api-access-9cngf\") pod \"postgres-864846d4f5-vscb9\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") " pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.445412 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.445311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5855f677-cf8e-4318-a1ba-4addf0569242-postgresdata\") pod \"postgres-864846d4f5-vscb9\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") " pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.546564 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.546543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cngf\" (UniqueName: \"kubernetes.io/projected/5855f677-cf8e-4318-a1ba-4addf0569242-kube-api-access-9cngf\") pod \"postgres-864846d4f5-vscb9\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") " pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.546659 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.546569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5855f677-cf8e-4318-a1ba-4addf0569242-postgresdata\") pod \"postgres-864846d4f5-vscb9\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") " pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.546901 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.546887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5855f677-cf8e-4318-a1ba-4addf0569242-postgresdata\") pod \"postgres-864846d4f5-vscb9\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") " pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.555973 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.555951    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cngf\" (UniqueName: \"kubernetes.io/projected/5855f677-cf8e-4318-a1ba-4addf0569242-kube-api-access-9cngf\") pod \"postgres-864846d4f5-vscb9\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") " pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.669314 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.669263    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:08:25.942896 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.942809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-vscb9"]
Sep 17 12:08:25.946389 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:08:25.946361    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5855f677_cf8e_4318_a1ba_4addf0569242.slice/crio-155597df4d282b4292d4f645d6c150f740e841f66c0d0889918ba6abcbf12886 WatchSource:0}: Error finding container 155597df4d282b4292d4f645d6c150f740e841f66c0d0889918ba6abcbf12886: Status 404 returned error can't find the container with id 155597df4d282b4292d4f645d6c150f740e841f66c0d0889918ba6abcbf12886
Sep 17 12:08:25.950957 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:25.950910    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 17 12:08:26.228921 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:26.228889    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9" event={"ID":"5855f677-cf8e-4318-a1ba-4addf0569242","Type":"ContainerStarted","Data":"d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd"}
Sep 17 12:08:26.228921 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:26.228927    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9" event={"ID":"5855f677-cf8e-4318-a1ba-4addf0569242","Type":"ContainerStarted","Data":"155597df4d282b4292d4f645d6c150f740e841f66c0d0889918ba6abcbf12886"}
Sep 17 12:08:26.249065 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:26.249022    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9" podStartSLOduration=1.249008451 podStartE2EDuration="1.249008451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:08:26.247801225 +0000 UTC m=+1020.940248752" watchObservedRunningTime="2026-09-17 12:08:26.249008451 +0000 UTC m=+1020.941455981"
Sep 17 12:08:30.971073 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.971037    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"]
Sep 17 12:08:30.977117 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.977096    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:30.979713 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.979690    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 17 12:08:30.979852 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.979720    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 17 12:08:30.979852 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.979811    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 17 12:08:30.979852 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.979847    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-dtxxm\""
Sep 17 12:08:30.995608 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:30.995585    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"]
Sep 17 12:08:31.086558 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.086533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-online-tls\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.086698 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.086576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm59z\" (UniqueName: \"kubernetes.io/projected/0deef53c-473b-447d-a30a-4089f5bed95d-kube-api-access-rm59z\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.086698 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.086607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0deef53c-473b-447d-a30a-4089f5bed95d-feast-data\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.086858 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.086710    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-registry-tls\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.188132 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.188101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-online-tls\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.188132 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.188136    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm59z\" (UniqueName: \"kubernetes.io/projected/0deef53c-473b-447d-a30a-4089f5bed95d-kube-api-access-rm59z\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.188323 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.188152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0deef53c-473b-447d-a30a-4089f5bed95d-feast-data\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.188323 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.188196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-registry-tls\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.188581 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.188559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0deef53c-473b-447d-a30a-4089f5bed95d-feast-data\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.190735 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.190712    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-online-tls\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.190837 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.190825    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-registry-tls\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.196988 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.196965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm59z\" (UniqueName: \"kubernetes.io/projected/0deef53c-473b-447d-a30a-4089f5bed95d-kube-api-access-rm59z\") pod \"feast-credit-scoring-5548ccd7c-dqvtf\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") " pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.288537 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.288466    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:31.565125 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:31.565094    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"]
Sep 17 12:08:31.566337 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:08:31.566307    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0deef53c_473b_447d_a30a_4089f5bed95d.slice/crio-d6d8414fb2ac062dd1ba33849138c2c0b832862b8cd8924d2a3d521545929a2f WatchSource:0}: Error finding container d6d8414fb2ac062dd1ba33849138c2c0b832862b8cd8924d2a3d521545929a2f: Status 404 returned error can't find the container with id d6d8414fb2ac062dd1ba33849138c2c0b832862b8cd8924d2a3d521545929a2f
Sep 17 12:08:32.253520 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:32.253484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerStarted","Data":"126877bd8c72105da5a7bae6f3badcd9acab0d71a982956367378b2feb2abdcc"}
Sep 17 12:08:32.253965 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:32.253547    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerStarted","Data":"d6d8414fb2ac062dd1ba33849138c2c0b832862b8cd8924d2a3d521545929a2f"}
Sep 17 12:08:33.259085 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:33.259051    2571 generic.go:356] "Generic (PLEG): container finished" podID="0deef53c-473b-447d-a30a-4089f5bed95d" containerID="126877bd8c72105da5a7bae6f3badcd9acab0d71a982956367378b2feb2abdcc" exitCode=0
Sep 17 12:08:33.259439 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:33.259137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerDied","Data":"126877bd8c72105da5a7bae6f3badcd9acab0d71a982956367378b2feb2abdcc"}
Sep 17 12:08:34.265708 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:34.265669    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerStarted","Data":"a1b2c95ddf28d0f33ee1e0b782052c1e6418bc46959795aa0b43285b721af498"}
Sep 17 12:08:40.291269 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:40.291237    2571 generic.go:356] "Generic (PLEG): container finished" podID="0deef53c-473b-447d-a30a-4089f5bed95d" containerID="a1b2c95ddf28d0f33ee1e0b782052c1e6418bc46959795aa0b43285b721af498" exitCode=0
Sep 17 12:08:40.291669 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:40.291309    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerDied","Data":"a1b2c95ddf28d0f33ee1e0b782052c1e6418bc46959795aa0b43285b721af498"}
Sep 17 12:08:41.298556 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:41.298524    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerStarted","Data":"e142e4d07be802c83500d07ffac0a9614b07a1f7a985859a9bfdaf275e13187a"}
Sep 17 12:08:41.299047 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:41.298587    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerStarted","Data":"5924ba93f228b34a903930229152b2166c30c3907e9593816f70db07a8d59b05"}
Sep 17 12:08:41.322130 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:41.322080    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podStartSLOduration=11.322062309 podStartE2EDuration="11.322062309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:08:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:08:41.321310909 +0000 UTC m=+1036.013758438" watchObservedRunningTime="2026-09-17 12:08:41.322062309 +0000 UTC m=+1036.014509839"
Sep 17 12:08:43.289653 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:43.289612    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:43.290121 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:43.289684    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:43.291148 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:43.291119    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Sep 17 12:08:43.291148 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:43.291135    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Sep 17 12:08:46.289258 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:46.289207    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Sep 17 12:08:46.289938 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:46.289902    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Sep 17 12:08:49.289445 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:49.289401    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
Sep 17 12:08:49.295391 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:49.295361    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:49.295815 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:49.295797    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:49.298634 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:49.298612    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:51.288803 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:51.288745    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:52.290056 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:52.290016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:52.359295 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:52.359269    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:08:56.844470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.844423    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"]
Sep 17 12:08:56.848177 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.848157    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:56.850536 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.850512    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 17 12:08:56.850791 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.850524    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-gfvpq\""
Sep 17 12:08:56.850791 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.850523    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 17 12:08:56.850988 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.850547    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 17 12:08:56.862257 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.862235    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"]
Sep 17 12:08:56.988733 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.988705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-online-tls\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:56.988883 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.988812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x8rs\" (UniqueName: \"kubernetes.io/projected/d55eddf9-b2be-4e36-8a84-ece156425868-kube-api-access-7x8rs\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:56.988883 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.988858    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d55eddf9-b2be-4e36-8a84-ece156425868-feast-data\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:56.989001 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:56.988942    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-registry-tls\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.090217 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.090187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-online-tls\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.090217 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.090217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x8rs\" (UniqueName: \"kubernetes.io/projected/d55eddf9-b2be-4e36-8a84-ece156425868-kube-api-access-7x8rs\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.090417 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.090239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d55eddf9-b2be-4e36-8a84-ece156425868-feast-data\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.090417 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.090269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-registry-tls\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.090656 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.090637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d55eddf9-b2be-4e36-8a84-ece156425868-feast-data\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.092657 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.092634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-online-tls\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.092729 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.092678    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-registry-tls\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.100738 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.100687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x8rs\" (UniqueName: \"kubernetes.io/projected/d55eddf9-b2be-4e36-8a84-ece156425868-kube-api-access-7x8rs\") pod \"feast-driver-ranking-58c44fbddb-q9xlg\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") " pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.157670 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.157653    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:08:57.433783 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:57.433684    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"]
Sep 17 12:08:57.436385 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:08:57.436359    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55eddf9_b2be_4e36_8a84_ece156425868.slice/crio-b3e2dc1429e22afb520e160268dd607b3efa2a5625f6d6e728522136d10637bc WatchSource:0}: Error finding container b3e2dc1429e22afb520e160268dd607b3efa2a5625f6d6e728522136d10637bc: Status 404 returned error can't find the container with id b3e2dc1429e22afb520e160268dd607b3efa2a5625f6d6e728522136d10637bc
Sep 17 12:08:58.385719 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:58.385688    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerStarted","Data":"cd5e0fa503f3e84bd2b6d771bd7518b279957b52c5f32c1843999bb0e89e1717"}
Sep 17 12:08:58.386190 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:08:58.385736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerStarted","Data":"b3e2dc1429e22afb520e160268dd607b3efa2a5625f6d6e728522136d10637bc"}
Sep 17 12:09:02.403461 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:02.403397    2571 generic.go:356] "Generic (PLEG): container finished" podID="d55eddf9-b2be-4e36-8a84-ece156425868" containerID="cd5e0fa503f3e84bd2b6d771bd7518b279957b52c5f32c1843999bb0e89e1717" exitCode=0
Sep 17 12:09:02.403821 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:02.403469    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerDied","Data":"cd5e0fa503f3e84bd2b6d771bd7518b279957b52c5f32c1843999bb0e89e1717"}
Sep 17 12:09:03.409087 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:03.409043    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerStarted","Data":"2dfd3c014e721924dffc7f13d17ae0ff61db8436c92708424863777792f78d3a"}
Sep 17 12:09:09.435166 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:09.435084    2571 generic.go:356] "Generic (PLEG): container finished" podID="d55eddf9-b2be-4e36-8a84-ece156425868" containerID="2dfd3c014e721924dffc7f13d17ae0ff61db8436c92708424863777792f78d3a" exitCode=0
Sep 17 12:09:09.435166 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:09.435132    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerDied","Data":"2dfd3c014e721924dffc7f13d17ae0ff61db8436c92708424863777792f78d3a"}
Sep 17 12:09:10.442996 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:10.442958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerStarted","Data":"eed32480527318efa75ad0a481591e3503b7d4814732bd17b0951a78c06beee2"}
Sep 17 12:09:10.443362 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:10.443029    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerStarted","Data":"ddce096312ad400dcffb7d2d31872a0ac63c245b1af979584ece446544e53164"}
Sep 17 12:09:10.470822 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:10.470745    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podStartSLOduration=14.470728068 podStartE2EDuration="14.470728068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:09:10.469259315 +0000 UTC m=+1065.161706847" watchObservedRunningTime="2026-09-17 12:09:10.470728068 +0000 UTC m=+1065.163175594"
Sep 17 12:09:12.158256 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:12.158220    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:12.158863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:12.158289    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:12.159501 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:12.159476    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Sep 17 12:09:12.159593 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:12.159507    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Sep 17 12:09:15.158646 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:15.158596    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Sep 17 12:09:15.159152 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:15.158685    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Sep 17 12:09:17.158540 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:17.158508    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:17.158970 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:17.158951    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:18.158449 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:18.158413    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Sep 17 12:09:18.164531 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:18.164495    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:18.486451 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:18.486425    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:21.158576 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:21.158547    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:09:21.159294 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:09:21.159274    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:10:40.309943 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.309914    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"]
Sep 17 12:10:40.310373 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.310094    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn" podUID="6bb0d961-5b6b-4fb5-9da0-03ca1179f890" containerName="manager" containerID="cri-o://24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b" gracePeriod=10
Sep 17 12:10:40.562508 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.562454    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 12:10:40.669652 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.669625    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"]
Sep 17 12:10:40.669923 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.669896    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry" containerID="cri-o://5924ba93f228b34a903930229152b2166c30c3907e9593816f70db07a8d59b05" gracePeriod=30
Sep 17 12:10:40.670065 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.669939    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online" containerID="cri-o://e142e4d07be802c83500d07ffac0a9614b07a1f7a985859a9bfdaf275e13187a" gracePeriod=30
Sep 17 12:10:40.672954 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.672880    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc8nm\" (UniqueName: \"kubernetes.io/projected/6bb0d961-5b6b-4fb5-9da0-03ca1179f890-kube-api-access-fc8nm\") pod \"6bb0d961-5b6b-4fb5-9da0-03ca1179f890\" (UID: \"6bb0d961-5b6b-4fb5-9da0-03ca1179f890\") "
Sep 17 12:10:40.676235 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.676203    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bb0d961-5b6b-4fb5-9da0-03ca1179f890-kube-api-access-fc8nm" (OuterVolumeSpecName: "kube-api-access-fc8nm") pod "6bb0d961-5b6b-4fb5-9da0-03ca1179f890" (UID: "6bb0d961-5b6b-4fb5-9da0-03ca1179f890"). InnerVolumeSpecName "kube-api-access-fc8nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:10:40.679382 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.679356    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"]
Sep 17 12:10:40.679695 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.679595    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry" containerID="cri-o://ddce096312ad400dcffb7d2d31872a0ac63c245b1af979584ece446544e53164" gracePeriod=30
Sep 17 12:10:40.679695 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.679629    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online" containerID="cri-o://eed32480527318efa75ad0a481591e3503b7d4814732bd17b0951a78c06beee2" gracePeriod=30
Sep 17 12:10:40.773853 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.773824    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc8nm\" (UniqueName: \"kubernetes.io/projected/6bb0d961-5b6b-4fb5-9da0-03ca1179f890-kube-api-access-fc8nm\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:10:40.833439 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.833365    2571 generic.go:356] "Generic (PLEG): container finished" podID="6bb0d961-5b6b-4fb5-9da0-03ca1179f890" containerID="24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b" exitCode=0
Sep 17 12:10:40.833439 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.833424    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"
Sep 17 12:10:40.833620 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.833456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn" event={"ID":"6bb0d961-5b6b-4fb5-9da0-03ca1179f890","Type":"ContainerDied","Data":"24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b"}
Sep 17 12:10:40.833620 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.833527    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn" event={"ID":"6bb0d961-5b6b-4fb5-9da0-03ca1179f890","Type":"ContainerDied","Data":"b9644fdd68a244b5b17b1b3fd69fc6aaf5a8969bf3f8b7cf145a346b28ad3972"}
Sep 17 12:10:40.833620 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.833549    2571 scope.go:117] "RemoveContainer" containerID="24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b"
Sep 17 12:10:40.842127 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.842108    2571 scope.go:117] "RemoveContainer" containerID="24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b"
Sep 17 12:10:40.842353 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:10:40.842336    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b\": container with ID starting with 24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b not found: ID does not exist" containerID="24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b"
Sep 17 12:10:40.842413 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.842358    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b"} err="failed to get container status \"24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b\": rpc error: code = NotFound desc = could not find container \"24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b\": container with ID starting with 24e6c2e14d8cffd98103e8f9d3999000eaa8e4b70d47aa1340ba04234953c61b not found: ID does not exist"
Sep 17 12:10:40.853805 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.853782    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"]
Sep 17 12:10:40.857857 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:40.857829    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5b6bb4b554-cmjtn"]
Sep 17 12:10:41.832450 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:41.832416    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bb0d961-5b6b-4fb5-9da0-03ca1179f890" path="/var/lib/kubelet/pods/6bb0d961-5b6b-4fb5-9da0-03ca1179f890/volumes"
Sep 17 12:10:41.840025 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:41.840003    2571 generic.go:356] "Generic (PLEG): container finished" podID="0deef53c-473b-447d-a30a-4089f5bed95d" containerID="e142e4d07be802c83500d07ffac0a9614b07a1f7a985859a9bfdaf275e13187a" exitCode=0
Sep 17 12:10:41.840149 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:41.840063    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerDied","Data":"e142e4d07be802c83500d07ffac0a9614b07a1f7a985859a9bfdaf275e13187a"}
Sep 17 12:10:41.843097 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:41.843076    2571 generic.go:356] "Generic (PLEG): container finished" podID="d55eddf9-b2be-4e36-8a84-ece156425868" containerID="eed32480527318efa75ad0a481591e3503b7d4814732bd17b0951a78c06beee2" exitCode=0
Sep 17 12:10:41.843190 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:41.843142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerDied","Data":"eed32480527318efa75ad0a481591e3503b7d4814732bd17b0951a78c06beee2"}
Sep 17 12:10:42.167321 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.167263    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-vscb9"]
Sep 17 12:10:42.167434 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.167415    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9" podUID="5855f677-cf8e-4318-a1ba-4addf0569242" containerName="postgres" containerID="cri-o://d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd" gracePeriod=30
Sep 17 12:10:42.175949 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.175920    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-p4txw"]
Sep 17 12:10:42.176220 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.176092    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw" podUID="0d42b2b3-688c-4d15-bf66-6534e5940d80" containerName="redis" containerID="cri-o://5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62" gracePeriod=30
Sep 17 12:10:42.433252 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.433230    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:10:42.439219 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.439199    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:10:42.486307 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.486280    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5855f677-cf8e-4318-a1ba-4addf0569242-postgresdata\") pod \"5855f677-cf8e-4318-a1ba-4addf0569242\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") "
Sep 17 12:10:42.486489 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.486332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqgn7\" (UniqueName: \"kubernetes.io/projected/0d42b2b3-688c-4d15-bf66-6534e5940d80-kube-api-access-kqgn7\") pod \"0d42b2b3-688c-4d15-bf66-6534e5940d80\" (UID: \"0d42b2b3-688c-4d15-bf66-6534e5940d80\") "
Sep 17 12:10:42.486489 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.486358    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cngf\" (UniqueName: \"kubernetes.io/projected/5855f677-cf8e-4318-a1ba-4addf0569242-kube-api-access-9cngf\") pod \"5855f677-cf8e-4318-a1ba-4addf0569242\" (UID: \"5855f677-cf8e-4318-a1ba-4addf0569242\") "
Sep 17 12:10:42.488695 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.488665    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d42b2b3-688c-4d15-bf66-6534e5940d80-kube-api-access-kqgn7" (OuterVolumeSpecName: "kube-api-access-kqgn7") pod "0d42b2b3-688c-4d15-bf66-6534e5940d80" (UID: "0d42b2b3-688c-4d15-bf66-6534e5940d80"). InnerVolumeSpecName "kube-api-access-kqgn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:10:42.488695 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.488675    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5855f677-cf8e-4318-a1ba-4addf0569242-kube-api-access-9cngf" (OuterVolumeSpecName: "kube-api-access-9cngf") pod "5855f677-cf8e-4318-a1ba-4addf0569242" (UID: "5855f677-cf8e-4318-a1ba-4addf0569242"). InnerVolumeSpecName "kube-api-access-9cngf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:10:42.520623 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.520598    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5855f677-cf8e-4318-a1ba-4addf0569242-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "5855f677-cf8e-4318-a1ba-4addf0569242" (UID: "5855f677-cf8e-4318-a1ba-4addf0569242"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:10:42.587167 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.587144    2571 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/5855f677-cf8e-4318-a1ba-4addf0569242-postgresdata\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:10:42.587167 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.587165    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqgn7\" (UniqueName: \"kubernetes.io/projected/0d42b2b3-688c-4d15-bf66-6534e5940d80-kube-api-access-kqgn7\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:10:42.587287 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.587175    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cngf\" (UniqueName: \"kubernetes.io/projected/5855f677-cf8e-4318-a1ba-4addf0569242-kube-api-access-9cngf\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:10:42.848618 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.848594    2571 generic.go:356] "Generic (PLEG): container finished" podID="0d42b2b3-688c-4d15-bf66-6534e5940d80" containerID="5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62" exitCode=0
Sep 17 12:10:42.849054 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.848648    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw"
Sep 17 12:10:42.849054 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.848688    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw" event={"ID":"0d42b2b3-688c-4d15-bf66-6534e5940d80","Type":"ContainerDied","Data":"5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62"}
Sep 17 12:10:42.849054 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.848736    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-p4txw" event={"ID":"0d42b2b3-688c-4d15-bf66-6534e5940d80","Type":"ContainerDied","Data":"e9e7f005e43a04538a15881ef886adb3e886d5f0491be3296358da5ceb20fcb8"}
Sep 17 12:10:42.849054 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.848754    2571 scope.go:117] "RemoveContainer" containerID="5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62"
Sep 17 12:10:42.850100 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.850078    2571 generic.go:356] "Generic (PLEG): container finished" podID="5855f677-cf8e-4318-a1ba-4addf0569242" containerID="d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd" exitCode=0
Sep 17 12:10:42.850179 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.850124    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9"
Sep 17 12:10:42.850336 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.850278    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9" event={"ID":"5855f677-cf8e-4318-a1ba-4addf0569242","Type":"ContainerDied","Data":"d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd"}
Sep 17 12:10:42.850401 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.850354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-vscb9" event={"ID":"5855f677-cf8e-4318-a1ba-4addf0569242","Type":"ContainerDied","Data":"155597df4d282b4292d4f645d6c150f740e841f66c0d0889918ba6abcbf12886"}
Sep 17 12:10:42.858997 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.858932    2571 scope.go:117] "RemoveContainer" containerID="5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62"
Sep 17 12:10:42.859433 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:10:42.859303    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62\": container with ID starting with 5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62 not found: ID does not exist" containerID="5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62"
Sep 17 12:10:42.859433 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.859337    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62"} err="failed to get container status \"5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62\": rpc error: code = NotFound desc = could not find container \"5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62\": container with ID starting with 5e853209a7de357b1c2fb9cfe31e61fc4dc492c5081a063e876ee8cc1163cf62 not found: ID does not exist"
Sep 17 12:10:42.859433 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.859359    2571 scope.go:117] "RemoveContainer" containerID="d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd"
Sep 17 12:10:42.867261 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.867245    2571 scope.go:117] "RemoveContainer" containerID="d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd"
Sep 17 12:10:42.867524 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:10:42.867506    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd\": container with ID starting with d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd not found: ID does not exist" containerID="d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd"
Sep 17 12:10:42.867608 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.867530    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd"} err="failed to get container status \"d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd\": rpc error: code = NotFound desc = could not find container \"d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd\": container with ID starting with d2036d5d607b1d7cd212bc139f7086c77b63a4f2715ffb6d20651f200d4e9afd not found: ID does not exist"
Sep 17 12:10:42.875631 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.875614    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-p4txw"]
Sep 17 12:10:42.879233 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.879214    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-p4txw"]
Sep 17 12:10:42.889758 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.889739    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-vscb9"]
Sep 17 12:10:42.891959 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:42.891934    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-vscb9"]
Sep 17 12:10:43.833144 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:43.833111    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d42b2b3-688c-4d15-bf66-6534e5940d80" path="/var/lib/kubelet/pods/0d42b2b3-688c-4d15-bf66-6534e5940d80/volumes"
Sep 17 12:10:43.833487 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:43.833473    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5855f677-cf8e-4318-a1ba-4addf0569242" path="/var/lib/kubelet/pods/5855f677-cf8e-4318-a1ba-4addf0569242/volumes"
Sep 17 12:10:48.482684 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:48.482584    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Sep 17 12:10:49.296350 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:49.296304    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Sep 17 12:10:58.482451 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:58.482413    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Sep 17 12:10:59.296458 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:10:59.296414    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Sep 17 12:11:08.482668 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:08.482618    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Sep 17 12:11:08.483195 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:08.482793    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:11:09.296102 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:09.296063    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
Sep 17 12:11:09.296284 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:09.296210    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:11:10.963242 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:10.963216    2571 generic.go:356] "Generic (PLEG): container finished" podID="d55eddf9-b2be-4e36-8a84-ece156425868" containerID="ddce096312ad400dcffb7d2d31872a0ac63c245b1af979584ece446544e53164" exitCode=137
Sep 17 12:11:10.963588 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:10.963284    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerDied","Data":"ddce096312ad400dcffb7d2d31872a0ac63c245b1af979584ece446544e53164"}
Sep 17 12:11:10.965640 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:10.965620    2571 generic.go:356] "Generic (PLEG): container finished" podID="0deef53c-473b-447d-a30a-4089f5bed95d" containerID="5924ba93f228b34a903930229152b2166c30c3907e9593816f70db07a8d59b05" exitCode=137
Sep 17 12:11:10.965751 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:10.965652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerDied","Data":"5924ba93f228b34a903930229152b2166c30c3907e9593816f70db07a8d59b05"}
Sep 17 12:11:11.159153 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.159127    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Sep 17 12:11:11.341860 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.341827    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:11:11.344834 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.344814    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:11:11.396271 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396251    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0deef53c-473b-447d-a30a-4089f5bed95d-feast-data\") pod \"0deef53c-473b-447d-a30a-4089f5bed95d\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") "
Sep 17 12:11:11.396374 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396294    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-online-tls\") pod \"0deef53c-473b-447d-a30a-4089f5bed95d\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") "
Sep 17 12:11:11.396374 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396333    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d55eddf9-b2be-4e36-8a84-ece156425868-feast-data\") pod \"d55eddf9-b2be-4e36-8a84-ece156425868\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") "
Sep 17 12:11:11.396374 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396355    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7x8rs\" (UniqueName: \"kubernetes.io/projected/d55eddf9-b2be-4e36-8a84-ece156425868-kube-api-access-7x8rs\") pod \"d55eddf9-b2be-4e36-8a84-ece156425868\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") "
Sep 17 12:11:11.396528 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396381    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rm59z\" (UniqueName: \"kubernetes.io/projected/0deef53c-473b-447d-a30a-4089f5bed95d-kube-api-access-rm59z\") pod \"0deef53c-473b-447d-a30a-4089f5bed95d\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") "
Sep 17 12:11:11.396528 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396407    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-registry-tls\") pod \"0deef53c-473b-447d-a30a-4089f5bed95d\" (UID: \"0deef53c-473b-447d-a30a-4089f5bed95d\") "
Sep 17 12:11:11.396528 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396448    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-online-tls\") pod \"d55eddf9-b2be-4e36-8a84-ece156425868\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") "
Sep 17 12:11:11.396528 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.396491    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-registry-tls\") pod \"d55eddf9-b2be-4e36-8a84-ece156425868\" (UID: \"d55eddf9-b2be-4e36-8a84-ece156425868\") "
Sep 17 12:11:11.397282 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.397255    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d55eddf9-b2be-4e36-8a84-ece156425868-feast-data" (OuterVolumeSpecName: "feast-data") pod "d55eddf9-b2be-4e36-8a84-ece156425868" (UID: "d55eddf9-b2be-4e36-8a84-ece156425868"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:11:11.399287 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.399254    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0deef53c-473b-447d-a30a-4089f5bed95d-kube-api-access-rm59z" (OuterVolumeSpecName: "kube-api-access-rm59z") pod "0deef53c-473b-447d-a30a-4089f5bed95d" (UID: "0deef53c-473b-447d-a30a-4089f5bed95d"). InnerVolumeSpecName "kube-api-access-rm59z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:11:11.399685 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.399658    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d55eddf9-b2be-4e36-8a84-ece156425868-kube-api-access-7x8rs" (OuterVolumeSpecName: "kube-api-access-7x8rs") pod "d55eddf9-b2be-4e36-8a84-ece156425868" (UID: "d55eddf9-b2be-4e36-8a84-ece156425868"). InnerVolumeSpecName "kube-api-access-7x8rs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:11:11.399800 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.399698    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d55eddf9-b2be-4e36-8a84-ece156425868" (UID: "d55eddf9-b2be-4e36-8a84-ece156425868"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:11:11.399800 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.399699    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0deef53c-473b-447d-a30a-4089f5bed95d" (UID: "0deef53c-473b-447d-a30a-4089f5bed95d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:11:11.400142 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.400125    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-online-tls" (OuterVolumeSpecName: "online-tls") pod "0deef53c-473b-447d-a30a-4089f5bed95d" (UID: "0deef53c-473b-447d-a30a-4089f5bed95d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:11:11.403025 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.403003    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-online-tls" (OuterVolumeSpecName: "online-tls") pod "d55eddf9-b2be-4e36-8a84-ece156425868" (UID: "d55eddf9-b2be-4e36-8a84-ece156425868"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:11:11.408095 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.408076    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0deef53c-473b-447d-a30a-4089f5bed95d-feast-data" (OuterVolumeSpecName: "feast-data") pod "0deef53c-473b-447d-a30a-4089f5bed95d" (UID: "0deef53c-473b-447d-a30a-4089f5bed95d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:11:11.497831 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497753    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d55eddf9-b2be-4e36-8a84-ece156425868-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.497831 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497804    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7x8rs\" (UniqueName: \"kubernetes.io/projected/d55eddf9-b2be-4e36-8a84-ece156425868-kube-api-access-7x8rs\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.497831 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497814    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rm59z\" (UniqueName: \"kubernetes.io/projected/0deef53c-473b-447d-a30a-4089f5bed95d-kube-api-access-rm59z\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.497831 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497825    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.497831 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497835    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.497831 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497843    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d55eddf9-b2be-4e36-8a84-ece156425868-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.498072 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497851    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0deef53c-473b-447d-a30a-4089f5bed95d-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.498072 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.497858    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0deef53c-473b-447d-a30a-4089f5bed95d-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:11:11.971658 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.971612    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg" event={"ID":"d55eddf9-b2be-4e36-8a84-ece156425868","Type":"ContainerDied","Data":"b3e2dc1429e22afb520e160268dd607b3efa2a5625f6d6e728522136d10637bc"}
Sep 17 12:11:11.972039 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.971714    2571 scope.go:117] "RemoveContainer" containerID="eed32480527318efa75ad0a481591e3503b7d4814732bd17b0951a78c06beee2"
Sep 17 12:11:11.972039 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.971642    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"
Sep 17 12:11:11.974425 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.974396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf" event={"ID":"0deef53c-473b-447d-a30a-4089f5bed95d","Type":"ContainerDied","Data":"d6d8414fb2ac062dd1ba33849138c2c0b832862b8cd8924d2a3d521545929a2f"}
Sep 17 12:11:11.974530 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.974492    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"
Sep 17 12:11:11.981043 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.981028    2571 scope.go:117] "RemoveContainer" containerID="ddce096312ad400dcffb7d2d31872a0ac63c245b1af979584ece446544e53164"
Sep 17 12:11:11.989979 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.989961    2571 scope.go:117] "RemoveContainer" containerID="2dfd3c014e721924dffc7f13d17ae0ff61db8436c92708424863777792f78d3a"
Sep 17 12:11:11.990051 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.990016    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"]
Sep 17 12:11:11.992957 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.992937    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-58c44fbddb-q9xlg"]
Sep 17 12:11:11.997729 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:11.997705    2571 scope.go:117] "RemoveContainer" containerID="cd5e0fa503f3e84bd2b6d771bd7518b279957b52c5f32c1843999bb0e89e1717"
Sep 17 12:11:12.004727 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:12.004710    2571 scope.go:117] "RemoveContainer" containerID="e142e4d07be802c83500d07ffac0a9614b07a1f7a985859a9bfdaf275e13187a"
Sep 17 12:11:12.007406 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:12.007387    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"]
Sep 17 12:11:12.014752 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:12.014727    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5548ccd7c-dqvtf"]
Sep 17 12:11:12.015079 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:12.015067    2571 scope.go:117] "RemoveContainer" containerID="5924ba93f228b34a903930229152b2166c30c3907e9593816f70db07a8d59b05"
Sep 17 12:11:12.022718 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:12.022702    2571 scope.go:117] "RemoveContainer" containerID="a1b2c95ddf28d0f33ee1e0b782052c1e6418bc46959795aa0b43285b721af498"
Sep 17 12:11:12.029520 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:12.029503    2571 scope.go:117] "RemoveContainer" containerID="126877bd8c72105da5a7bae6f3badcd9acab0d71a982956367378b2feb2abdcc"
Sep 17 12:11:13.833148 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:13.833114    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" path="/var/lib/kubelet/pods/0deef53c-473b-447d-a30a-4089f5bed95d/volumes"
Sep 17 12:11:13.833859 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:13.833836    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" path="/var/lib/kubelet/pods/d55eddf9-b2be-4e36-8a84-ece156425868/volumes"
Sep 17 12:11:20.692811 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.692755    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"]
Sep 17 12:11:20.693266 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693189    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d42b2b3-688c-4d15-bf66-6534e5940d80" containerName="redis"
Sep 17 12:11:20.693266 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693203    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d42b2b3-688c-4d15-bf66-6534e5940d80" containerName="redis"
Sep 17 12:11:20.693266 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693237    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="feast-apply"
Sep 17 12:11:20.693266 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693246    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="feast-apply"
Sep 17 12:11:20.693266 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693266    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bb0d961-5b6b-4fb5-9da0-03ca1179f890" containerName="manager"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693274    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bb0d961-5b6b-4fb5-9da0-03ca1179f890" containerName="manager"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693283    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693292    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693301    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693309    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693324    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5855f677-cf8e-4318-a1ba-4addf0569242" containerName="postgres"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693332    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5855f677-cf8e-4318-a1ba-4addf0569242" containerName="postgres"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693342    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="feast-apply"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693349    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="feast-apply"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693363    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="feast-init"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693370    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="feast-init"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693379    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693387    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693395    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693403    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693414    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="feast-init"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693424    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="feast-init"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693488    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bb0d961-5b6b-4fb5-9da0-03ca1179f890" containerName="manager"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693500    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5855f677-cf8e-4318-a1ba-4addf0569242" containerName="postgres"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693509    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="online"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693517    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="registry"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693526    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d42b2b3-688c-4d15-bf66-6534e5940d80" containerName="redis"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693535    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d55eddf9-b2be-4e36-8a84-ece156425868" containerName="online"
Sep 17 12:11:20.693534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.693543    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0deef53c-473b-447d-a30a-4089f5bed95d" containerName="registry"
Sep 17 12:11:20.696873 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.696847    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.699441 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.699422    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 12:11:20.699575 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.699507    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 12:11:20.699725 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.699422    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 12:11:20.699956 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.699939    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 12:11:20.700070 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.699994    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5nmnq\""
Sep 17 12:11:20.700136 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.699943    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 12:11:20.700201 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.700179    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 12:11:20.708920 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.708901    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"]
Sep 17 12:11:20.761720 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.761695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.761861 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.761733    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.761861 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.761762    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.761861 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.761839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a846802-c780-416a-992e-a2e1e5e439d5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.762027 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.761872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w7ll\" (UniqueName: \"kubernetes.io/projected/2a846802-c780-416a-992e-a2e1e5e439d5-kube-api-access-5w7ll\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.762027 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.761908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.862661 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.862636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.862816 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.862672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.862816 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.862698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862822    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862829    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862826    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.862873    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862894    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls podName:2a846802-c780-416a-992e-a2e1e5e439d5 nodeName:}" failed. No retries permitted until 2026-09-17 12:11:21.362876684 +0000 UTC m=+1196.055324211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-ms6xf" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862917    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls podName:2a846802-c780-416a-992e-a2e1e5e439d5 nodeName:}" failed. No retries permitted until 2026-09-17 12:11:21.362908664 +0000 UTC m=+1196.055356186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-ms6xf" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 12:11:20.862934 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862932    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls podName:2a846802-c780-416a-992e-a2e1e5e439d5 nodeName:}" failed. No retries permitted until 2026-09-17 12:11:21.362924369 +0000 UTC m=+1196.055371883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls") pod "feast-simple-feast-setup-57576b8fcf-ms6xf" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:11:20.863301 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862948    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 12:11:20.863301 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.862965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a846802-c780-416a-992e-a2e1e5e439d5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.863301 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:20.862993    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls podName:2a846802-c780-416a-992e-a2e1e5e439d5 nodeName:}" failed. No retries permitted until 2026-09-17 12:11:21.362984606 +0000 UTC m=+1196.055432131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-ms6xf" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 12:11:20.863301 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.863027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w7ll\" (UniqueName: \"kubernetes.io/projected/2a846802-c780-416a-992e-a2e1e5e439d5-kube-api-access-5w7ll\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.863525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.863334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a846802-c780-416a-992e-a2e1e5e439d5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:20.874287 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:20.874266    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w7ll\" (UniqueName: \"kubernetes.io/projected/2a846802-c780-416a-992e-a2e1e5e439d5-kube-api-access-5w7ll\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.367556 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.367527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.367721 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.367563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.367721 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.367605    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.367721 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.367638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.367885 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:21.367786    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 12:11:21.367885 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:11:21.367857    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls podName:2a846802-c780-416a-992e-a2e1e5e439d5 nodeName:}" failed. No retries permitted until 2026-09-17 12:11:22.367838362 +0000 UTC m=+1197.060285885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-ms6xf" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 12:11:21.370168 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.370147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.370572 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.370557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:21.370640 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:21.370588    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:22.374427 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:22.374390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:22.376984 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:22.376959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-ms6xf\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:22.517848 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:22.517817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:22.795167 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:22.795145    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"]
Sep 17 12:11:22.797658 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:11:22.797634    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a846802_c780_416a_992e_a2e1e5e439d5.slice/crio-e8b7fbe74e9af609a792593ff40d6ccb18d6386c291bdb166d3160d968d82d95 WatchSource:0}: Error finding container e8b7fbe74e9af609a792593ff40d6ccb18d6386c291bdb166d3160d968d82d95: Status 404 returned error can't find the container with id e8b7fbe74e9af609a792593ff40d6ccb18d6386c291bdb166d3160d968d82d95
Sep 17 12:11:23.021204 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:23.021175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"e8b7fbe74e9af609a792593ff40d6ccb18d6386c291bdb166d3160d968d82d95"}
Sep 17 12:11:36.087345 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:36.087304    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"d13632bb4ead389a07a22884812cc096d76c9c17bbe5ddc66a29a72564690587"}
Sep 17 12:11:41.107205 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:41.107170    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a846802-c780-416a-992e-a2e1e5e439d5" containerID="d13632bb4ead389a07a22884812cc096d76c9c17bbe5ddc66a29a72564690587" exitCode=0
Sep 17 12:11:41.107643 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:41.107242    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"d13632bb4ead389a07a22884812cc096d76c9c17bbe5ddc66a29a72564690587"}
Sep 17 12:11:42.112758 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:42.112724    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"15d4ec748e3c0554fa70f5e06e7ffacbc6660e5248ab5b11e94c7542cd05f0d5"}
Sep 17 12:11:49.142822 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:49.142785    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a846802-c780-416a-992e-a2e1e5e439d5" containerID="15d4ec748e3c0554fa70f5e06e7ffacbc6660e5248ab5b11e94c7542cd05f0d5" exitCode=0
Sep 17 12:11:49.142822 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:49.142803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"15d4ec748e3c0554fa70f5e06e7ffacbc6660e5248ab5b11e94c7542cd05f0d5"}
Sep 17 12:11:50.153805 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:50.153738    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"ad5bc8722bd92bd1141dd11ed711c1d26aedd44199e7623702f1a21b86979b2b"}
Sep 17 12:11:50.154287 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:50.153825    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"970c6742b2509609261dcf39f5fe273721413f89559189b525b769c9d81facef"}
Sep 17 12:11:50.154287 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:50.153848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"b372866b36b75f7b1fc54ab1cf7713ea1626ba2caeb8d2ab08eb4e2276031bd5"}
Sep 17 12:11:50.154287 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:50.153865    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerStarted","Data":"e856f3a4cc4effa5c67409927104da6f529ac9ad428afa50b57ab139d7c29732"}
Sep 17 12:11:50.180199 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:50.180138    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podStartSLOduration=17.336623229 podStartE2EDuration="30.180117247s" totalImagesPullingTime="12.843494018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:11:50.178662581 +0000 UTC m=+1224.871110112" watchObservedRunningTime="2026-09-17 12:11:50.180117247 +0000 UTC m=+1224.872564770"
Sep 17 12:11:52.518690 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.518651    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519299 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519308    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519327    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519345    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519364    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519380    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.519444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.519398    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:52.520946 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.520913    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
Sep 17 12:11:52.521170 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.520934    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
Sep 17 12:11:52.521261 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.520953    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Sep 17 12:11:52.521261 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:52.520998    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Sep 17 12:11:55.518590 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:55.518499    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
Sep 17 12:11:55.518590 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:55.518534    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Sep 17 12:11:55.518590 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:55.518499    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
Sep 17 12:11:55.519211 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:55.518499    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Sep 17 12:11:58.519704 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.519675    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:58.520064 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.519797    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:58.520064 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.520012    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:58.520584 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.520564    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:58.520902 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.520888    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:58.521889 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.521870    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:58.524934 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:58.524916    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:11:59.202094 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:11:59.202070    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:13:01.050929 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.050894    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"]
Sep 17 12:13:01.051427 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.051121    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="registry" containerID="cri-o://e856f3a4cc4effa5c67409927104da6f529ac9ad428afa50b57ab139d7c29732" gracePeriod=30
Sep 17 12:13:01.051427 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.051189    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="offline" containerID="cri-o://970c6742b2509609261dcf39f5fe273721413f89559189b525b769c9d81facef" gracePeriod=30
Sep 17 12:13:01.051427 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.051191    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui" containerID="cri-o://ad5bc8722bd92bd1141dd11ed711c1d26aedd44199e7623702f1a21b86979b2b" gracePeriod=30
Sep 17 12:13:01.051427 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.051194    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online" containerID="cri-o://b372866b36b75f7b1fc54ab1cf7713ea1626ba2caeb8d2ab08eb4e2276031bd5" gracePeriod=30
Sep 17 12:13:01.443258 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.443173    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"]
Sep 17 12:13:01.447099 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.447072    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.450066 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.450041    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gp5h5\""
Sep 17 12:13:01.466085 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.466057    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"]
Sep 17 12:13:01.532111 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.532068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.532439 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.532397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2fkh\" (UniqueName: \"kubernetes.io/projected/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-kube-api-access-p2fkh\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.532574 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.532451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.532574 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.532547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.532688 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.532589    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.532688 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.532633    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.633730 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.633680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.633730 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.633728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2fkh\" (UniqueName: \"kubernetes.io/projected/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-kube-api-access-p2fkh\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.633999 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.633761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.633999 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.633821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.633999 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.633855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.633999 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.633884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.634193 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:13:01.634009    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 12:13:01.634193 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:13:01.634072    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls podName:c82e38bd-d954-4c5a-ab8a-d1e070cc75f7 nodeName:}" failed. No retries permitted until 2026-09-17 12:13:02.134050041 +0000 UTC m=+1296.826497561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-zgc5d" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 12:13:01.634574 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.634500    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.636744 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.636705    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.636962 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.636938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.637400 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.637378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:01.644499 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:01.644394    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2fkh\" (UniqueName: \"kubernetes.io/projected/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-kube-api-access-p2fkh\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:02.138988 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.138914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:02.141401 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.141382    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-zgc5d\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:02.357581 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.357552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:02.455806 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.455776    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a846802-c780-416a-992e-a2e1e5e439d5" containerID="ad5bc8722bd92bd1141dd11ed711c1d26aedd44199e7623702f1a21b86979b2b" exitCode=0
Sep 17 12:13:02.455806 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.455802    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a846802-c780-416a-992e-a2e1e5e439d5" containerID="b372866b36b75f7b1fc54ab1cf7713ea1626ba2caeb8d2ab08eb4e2276031bd5" exitCode=0
Sep 17 12:13:02.455976 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.455835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"ad5bc8722bd92bd1141dd11ed711c1d26aedd44199e7623702f1a21b86979b2b"}
Sep 17 12:13:02.455976 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.455881    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"b372866b36b75f7b1fc54ab1cf7713ea1626ba2caeb8d2ab08eb4e2276031bd5"}
Sep 17 12:13:02.631716 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:02.631693    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"]
Sep 17 12:13:02.632187 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:13:02.632163    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc82e38bd_d954_4c5a_ab8a_d1e070cc75f7.slice/crio-bce7addce3575f81c0b27da4292ca248c2711cbff20e896cc7e055abd2e5ef0a WatchSource:0}: Error finding container bce7addce3575f81c0b27da4292ca248c2711cbff20e896cc7e055abd2e5ef0a: Status 404 returned error can't find the container with id bce7addce3575f81c0b27da4292ca248c2711cbff20e896cc7e055abd2e5ef0a
Sep 17 12:13:03.461808 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:03.461741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"51740bf4f974ee2da208101658723a4f2a89df253ff4a4dd628a87250afa205e"}
Sep 17 12:13:03.462177 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:03.461827    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"bce7addce3575f81c0b27da4292ca248c2711cbff20e896cc7e055abd2e5ef0a"}
Sep 17 12:13:07.482661 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:07.482630    2571 generic.go:356] "Generic (PLEG): container finished" podID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerID="51740bf4f974ee2da208101658723a4f2a89df253ff4a4dd628a87250afa205e" exitCode=0
Sep 17 12:13:07.483031 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:07.482682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"51740bf4f974ee2da208101658723a4f2a89df253ff4a4dd628a87250afa205e"}
Sep 17 12:13:08.489041 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:08.489008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"48eaa62350a5cacd980cb490e8e3b2692f34b2281e4aa70e3d5ec88c83251fd3"}
Sep 17 12:13:08.521346 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:08.521303    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Sep 17 12:13:09.199521 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:09.199479    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Sep 17 12:13:13.512386 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:13.512355    2571 generic.go:356] "Generic (PLEG): container finished" podID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerID="48eaa62350a5cacd980cb490e8e3b2692f34b2281e4aa70e3d5ec88c83251fd3" exitCode=0
Sep 17 12:13:13.512723 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:13.512427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"48eaa62350a5cacd980cb490e8e3b2692f34b2281e4aa70e3d5ec88c83251fd3"}
Sep 17 12:13:14.523394 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:14.523353    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"dc94b0d76196b5e6830943c8b124315e945a6c5a908a39abcdba010988bf2c15"}
Sep 17 12:13:14.523914 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:14.523421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"980e9ebb6e5b5ddc93efe979618e6ad29a11f7454aaf32e937179eb848412f7f"}
Sep 17 12:13:14.523914 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:14.523442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"39d27af3429600ec4355038463da9e90feba6c9a44ea4b20329745dc91858d4e"}
Sep 17 12:13:14.523914 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:14.523462    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerStarted","Data":"f3bcdf7a0e23a8b2a3c30629120073cef9511bccf560f28bb76f7cfefa0570d5"}
Sep 17 12:13:14.553938 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:14.553876    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podStartSLOduration=13.553856445 podStartE2EDuration="13.553856445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:13:14.551392143 +0000 UTC m=+1309.243839676" watchObservedRunningTime="2026-09-17 12:13:14.553856445 +0000 UTC m=+1309.246303979"
Sep 17 12:13:17.358291 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.358240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:17.358756 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.358301    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:17.358756 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.358322    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:17.358756 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.358340    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:17.360256 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.360223    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.34:6571: connect: connection refused"
Sep 17 12:13:17.360489 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.360244    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 12:13:17.360603 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.360318    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Sep 17 12:13:17.360603 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:17.360361    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
Sep 17 12:13:18.520848 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:18.520798    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Sep 17 12:13:19.199586 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:19.199534    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Sep 17 12:13:20.358463 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:20.358416    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
Sep 17 12:13:20.359974 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:20.358416    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.34:6571: connect: connection refused"
Sep 17 12:13:20.359974 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:20.358958    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 12:13:20.359974 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:20.358985    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Sep 17 12:13:22.358331 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:22.358303    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:22.358693 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:22.358350    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:22.358693 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:22.358367    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:22.358693 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:22.358381    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.359404 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.359171    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.359855 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.359511    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.361005 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.360985    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.364638 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.364614    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.572215 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.572191    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.572384 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.572272    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.572492 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.572473    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:23.574872 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:23.574853    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:13:28.520720 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:28.520677    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Sep 17 12:13:28.521190 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:28.520845    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:13:29.199672 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:29.199629    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Sep 17 12:13:29.199885 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:29.199757    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:13:31.613204 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.613169    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a846802-c780-416a-992e-a2e1e5e439d5" containerID="970c6742b2509609261dcf39f5fe273721413f89559189b525b769c9d81facef" exitCode=137
Sep 17 12:13:31.613204 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.613194    2571 generic.go:356] "Generic (PLEG): container finished" podID="2a846802-c780-416a-992e-a2e1e5e439d5" containerID="e856f3a4cc4effa5c67409927104da6f529ac9ad428afa50b57ab139d7c29732" exitCode=137
Sep 17 12:13:31.613633 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.613248    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"970c6742b2509609261dcf39f5fe273721413f89559189b525b769c9d81facef"}
Sep 17 12:13:31.613633 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.613306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"e856f3a4cc4effa5c67409927104da6f529ac9ad428afa50b57ab139d7c29732"}
Sep 17 12:13:31.707075 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.707050    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:13:31.798305 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.798281    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") pod \"2a846802-c780-416a-992e-a2e1e5e439d5\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") "
Sep 17 12:13:31.798438 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.798344    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls\") pod \"2a846802-c780-416a-992e-a2e1e5e439d5\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") "
Sep 17 12:13:31.798438 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.798377    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls\") pod \"2a846802-c780-416a-992e-a2e1e5e439d5\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") "
Sep 17 12:13:31.798438 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.798414    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls\") pod \"2a846802-c780-416a-992e-a2e1e5e439d5\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") "
Sep 17 12:13:31.798614 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.798459    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w7ll\" (UniqueName: \"kubernetes.io/projected/2a846802-c780-416a-992e-a2e1e5e439d5-kube-api-access-5w7ll\") pod \"2a846802-c780-416a-992e-a2e1e5e439d5\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") "
Sep 17 12:13:31.798614 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.798489    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a846802-c780-416a-992e-a2e1e5e439d5-feast-data\") pod \"2a846802-c780-416a-992e-a2e1e5e439d5\" (UID: \"2a846802-c780-416a-992e-a2e1e5e439d5\") "
Sep 17 12:13:31.799346 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.799315    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a846802-c780-416a-992e-a2e1e5e439d5-feast-data" (OuterVolumeSpecName: "feast-data") pod "2a846802-c780-416a-992e-a2e1e5e439d5" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:13:31.800802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.800755    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2a846802-c780-416a-992e-a2e1e5e439d5" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:13:31.800906 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.800833    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2a846802-c780-416a-992e-a2e1e5e439d5" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:13:31.800906 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.800872    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls" (OuterVolumeSpecName: "online-tls") pod "2a846802-c780-416a-992e-a2e1e5e439d5" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:13:31.801130 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.801113    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2a846802-c780-416a-992e-a2e1e5e439d5" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:13:31.801250 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.801233    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a846802-c780-416a-992e-a2e1e5e439d5-kube-api-access-5w7ll" (OuterVolumeSpecName: "kube-api-access-5w7ll") pod "2a846802-c780-416a-992e-a2e1e5e439d5" (UID: "2a846802-c780-416a-992e-a2e1e5e439d5"). InnerVolumeSpecName "kube-api-access-5w7ll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:13:31.899687 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.899654    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:13:31.899687 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.899691    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:13:31.899838 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.899702    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:13:31.899838 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.899710    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2a846802-c780-416a-992e-a2e1e5e439d5-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:13:31.899838 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.899718    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w7ll\" (UniqueName: \"kubernetes.io/projected/2a846802-c780-416a-992e-a2e1e5e439d5-kube-api-access-5w7ll\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:13:31.899838 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:31.899727    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2a846802-c780-416a-992e-a2e1e5e439d5-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:13:32.621592 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.621560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf" event={"ID":"2a846802-c780-416a-992e-a2e1e5e439d5","Type":"ContainerDied","Data":"e8b7fbe74e9af609a792593ff40d6ccb18d6386c291bdb166d3160d968d82d95"}
Sep 17 12:13:32.621592 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.621583    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"
Sep 17 12:13:32.622215 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.621621    2571 scope.go:117] "RemoveContainer" containerID="ad5bc8722bd92bd1141dd11ed711c1d26aedd44199e7623702f1a21b86979b2b"
Sep 17 12:13:32.630509 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.630487    2571 scope.go:117] "RemoveContainer" containerID="970c6742b2509609261dcf39f5fe273721413f89559189b525b769c9d81facef"
Sep 17 12:13:32.638648 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.638615    2571 scope.go:117] "RemoveContainer" containerID="b372866b36b75f7b1fc54ab1cf7713ea1626ba2caeb8d2ab08eb4e2276031bd5"
Sep 17 12:13:32.642575 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.642554    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"]
Sep 17 12:13:32.646364 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.646339    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-ms6xf"]
Sep 17 12:13:32.647566 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.647551    2571 scope.go:117] "RemoveContainer" containerID="e856f3a4cc4effa5c67409927104da6f529ac9ad428afa50b57ab139d7c29732"
Sep 17 12:13:32.655140 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.655125    2571 scope.go:117] "RemoveContainer" containerID="15d4ec748e3c0554fa70f5e06e7ffacbc6660e5248ab5b11e94c7542cd05f0d5"
Sep 17 12:13:32.662445 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:32.662430    2571 scope.go:117] "RemoveContainer" containerID="d13632bb4ead389a07a22884812cc096d76c9c17bbe5ddc66a29a72564690587"
Sep 17 12:13:33.832188 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:13:33.832154    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" path="/var/lib/kubelet/pods/2a846802-c780-416a-992e-a2e1e5e439d5/volumes"
Sep 17 12:14:26.392280 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392244    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"]
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392681    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="feast-init"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392699    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="feast-init"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392710    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="feast-apply"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392718    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="feast-apply"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392728    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="offline"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392737    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="offline"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392752    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392760    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392792    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="registry"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392800    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="registry"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392812    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392820    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392908    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="registry"
Sep 17 12:14:26.392917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392919    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="online"
Sep 17 12:14:26.393626 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392927    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="ui"
Sep 17 12:14:26.393626 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.392941    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a846802-c780-416a-992e-a2e1e5e439d5" containerName="offline"
Sep 17 12:14:26.396362 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.396342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.398754 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.398732    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 12:14:26.398917 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.398893    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 12:14:26.399013 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.398929    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-kjsgq\""
Sep 17 12:14:26.399013 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.398947    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 12:14:26.399013 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.398988    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 12:14:26.399191 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.399177    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 12:14:26.399805 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.399786    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 12:14:26.407037 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.407018    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"]
Sep 17 12:14:26.586640 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.586619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/154caedb-df59-4a90-a1cc-971c646d9cfd-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.586786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.586648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55k7h\" (UniqueName: \"kubernetes.io/projected/154caedb-df59-4a90-a1cc-971c646d9cfd-kube-api-access-55k7h\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.586786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.586679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.586786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.586706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.586786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.586745    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/154caedb-df59-4a90-a1cc-971c646d9cfd-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.586786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.586782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.687554 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.687501    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.687554 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.687536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.687554 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.687554    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/154caedb-df59-4a90-a1cc-971c646d9cfd-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.687733 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.687574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.687733 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.687615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/154caedb-df59-4a90-a1cc-971c646d9cfd-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.687733 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.687629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55k7h\" (UniqueName: \"kubernetes.io/projected/154caedb-df59-4a90-a1cc-971c646d9cfd-kube-api-access-55k7h\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.688039 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.688018    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/154caedb-df59-4a90-a1cc-971c646d9cfd-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.688352 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.688333    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/154caedb-df59-4a90-a1cc-971c646d9cfd-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.690242 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.690218    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.690648 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.690631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.690826 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.690808    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.696894 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.696869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55k7h\" (UniqueName: \"kubernetes.io/projected/154caedb-df59-4a90-a1cc-971c646d9cfd-kube-api-access-55k7h\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-kc7kv\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:26.706505 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:26.706483    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:27.030420 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:27.030394    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"]
Sep 17 12:14:27.032846 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:14:27.032820    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod154caedb_df59_4a90_a1cc_971c646d9cfd.slice/crio-f863217bdd3a4aa7d9b288a828a0ae069c69df8b76c47e2441011b2730dcf50c WatchSource:0}: Error finding container f863217bdd3a4aa7d9b288a828a0ae069c69df8b76c47e2441011b2730dcf50c: Status 404 returned error can't find the container with id f863217bdd3a4aa7d9b288a828a0ae069c69df8b76c47e2441011b2730dcf50c
Sep 17 12:14:27.857400 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:27.857359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerStarted","Data":"ff94684a85166d724644c87ca19e53e2e610b7d7514505cd0215c8657d303bc4"}
Sep 17 12:14:27.857400 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:27.857401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerStarted","Data":"f863217bdd3a4aa7d9b288a828a0ae069c69df8b76c47e2441011b2730dcf50c"}
Sep 17 12:14:31.874220 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:31.874190    2571 generic.go:356] "Generic (PLEG): container finished" podID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerID="ff94684a85166d724644c87ca19e53e2e610b7d7514505cd0215c8657d303bc4" exitCode=0
Sep 17 12:14:31.874518 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:31.874263    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerDied","Data":"ff94684a85166d724644c87ca19e53e2e610b7d7514505cd0215c8657d303bc4"}
Sep 17 12:14:32.880326 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:32.880295    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerStarted","Data":"e20acc8c66408c053767e03e0c538ce70347486e0ffd6cde812d494259e65f0f"}
Sep 17 12:14:55.975816 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:55.975761    2571 generic.go:356] "Generic (PLEG): container finished" podID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerID="e20acc8c66408c053767e03e0c538ce70347486e0ffd6cde812d494259e65f0f" exitCode=0
Sep 17 12:14:55.976236 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:55.975838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerDied","Data":"e20acc8c66408c053767e03e0c538ce70347486e0ffd6cde812d494259e65f0f"}
Sep 17 12:14:56.994199 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:56.994150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerStarted","Data":"bbf2c74f6d1fe450ae52563d0e90fb5176e877cb5a20b3bc93e806a67e8ba05c"}
Sep 17 12:14:56.994685 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:56.994229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerStarted","Data":"fd8028c60361528a3a472a6e2920b619135c52ecda4976d0c2fabdcab0d8e757"}
Sep 17 12:14:56.994685 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:56.994387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerStarted","Data":"bd0b2d04e578d7f3530e29d2666d7237c757b9b1920613b6a0d605a56148f371"}
Sep 17 12:14:57.020387 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:57.020338    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podStartSLOduration=31.020320112 podStartE2EDuration="31.020320112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:14:57.019188335 +0000 UTC m=+1411.711635867" watchObservedRunningTime="2026-09-17 12:14:57.020320112 +0000 UTC m=+1411.712767643"
Sep 17 12:14:59.707641 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:59.707609    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:59.708232 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:59.707664    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:59.708232 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:59.707685    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:14:59.709251 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:59.709215    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Sep 17 12:14:59.709251 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:59.709237    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.35:8816: connect: connection refused"
Sep 17 12:14:59.709409 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:14:59.709274    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Sep 17 12:15:02.707196 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:02.707148    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Sep 17 12:15:02.707656 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:02.707140    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Sep 17 12:15:02.707656 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:02.707145    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.35:8816: connect: connection refused"
Sep 17 12:15:05.707892 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:05.707865    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:05.708258 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:05.708041    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:05.708442 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:05.708420    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:05.708532 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:05.708455    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:05.708740 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:05.708702    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:05.708900 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:05.708886    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:06.707364 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:06.707326    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:06.711896 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:06.711863    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 12:15:09.458698 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:09.458672    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:15:10.190870 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:15:10.190841    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:16:07.710930 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:07.710890    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 12:16:12.822529 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:12.822491    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"]
Sep 17 12:16:12.822972 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:12.822802    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" containerID="cri-o://bd0b2d04e578d7f3530e29d2666d7237c757b9b1920613b6a0d605a56148f371" gracePeriod=30
Sep 17 12:16:12.822972 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:12.822897    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui" containerID="cri-o://bbf2c74f6d1fe450ae52563d0e90fb5176e877cb5a20b3bc93e806a67e8ba05c" gracePeriod=30
Sep 17 12:16:12.822972 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:12.822935    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="offline" containerID="cri-o://fd8028c60361528a3a472a6e2920b619135c52ecda4976d0c2fabdcab0d8e757" gracePeriod=30
Sep 17 12:16:13.020504 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.020470    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"]
Sep 17 12:16:13.020834 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.020753    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry" containerID="cri-o://f3bcdf7a0e23a8b2a3c30629120073cef9511bccf560f28bb76f7cfefa0570d5" gracePeriod=30
Sep 17 12:16:13.020983 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.020882    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline" containerID="cri-o://980e9ebb6e5b5ddc93efe979618e6ad29a11f7454aaf32e937179eb848412f7f" gracePeriod=30
Sep 17 12:16:13.020983 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.020882    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" containerID="cri-o://dc94b0d76196b5e6830943c8b124315e945a6c5a908a39abcdba010988bf2c15" gracePeriod=30
Sep 17 12:16:13.021103 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.020889    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" containerID="cri-o://39d27af3429600ec4355038463da9e90feba6c9a44ea4b20329745dc91858d4e" gracePeriod=30
Sep 17 12:16:13.572333 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.572277    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 12:16:13.572333 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:13.572306    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Sep 17 12:16:14.320830 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.320791    2571 generic.go:356] "Generic (PLEG): container finished" podID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerID="dc94b0d76196b5e6830943c8b124315e945a6c5a908a39abcdba010988bf2c15" exitCode=0
Sep 17 12:16:14.320830 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.320818    2571 generic.go:356] "Generic (PLEG): container finished" podID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerID="39d27af3429600ec4355038463da9e90feba6c9a44ea4b20329745dc91858d4e" exitCode=0
Sep 17 12:16:14.321295 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.320858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"dc94b0d76196b5e6830943c8b124315e945a6c5a908a39abcdba010988bf2c15"}
Sep 17 12:16:14.321295 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.320910    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"39d27af3429600ec4355038463da9e90feba6c9a44ea4b20329745dc91858d4e"}
Sep 17 12:16:14.323813 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.323791    2571 generic.go:356] "Generic (PLEG): container finished" podID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerID="bbf2c74f6d1fe450ae52563d0e90fb5176e877cb5a20b3bc93e806a67e8ba05c" exitCode=0
Sep 17 12:16:14.323813 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.323810    2571 generic.go:356] "Generic (PLEG): container finished" podID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerID="bd0b2d04e578d7f3530e29d2666d7237c757b9b1920613b6a0d605a56148f371" exitCode=0
Sep 17 12:16:14.323973 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.323854    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerDied","Data":"bbf2c74f6d1fe450ae52563d0e90fb5176e877cb5a20b3bc93e806a67e8ba05c"}
Sep 17 12:16:14.323973 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:14.323889    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerDied","Data":"bd0b2d04e578d7f3530e29d2666d7237c757b9b1920613b6a0d605a56148f371"}
Sep 17 12:16:15.709495 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:15.709453    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Sep 17 12:16:19.459451 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:19.459412    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Sep 17 12:16:23.572488 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:23.572442    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 12:16:23.572911 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:23.572454    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Sep 17 12:16:25.709467 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:25.709422    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Sep 17 12:16:29.460130 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:29.460089    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Sep 17 12:16:33.572300 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:33.572257    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 12:16:33.572809 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:33.572302    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Sep 17 12:16:33.572809 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:33.572415    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:16:33.572809 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:33.572495    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:16:35.709374 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:35.709328    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.35:8443: connect: connection refused"
Sep 17 12:16:35.709847 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:35.709460    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:16:39.460279 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:39.460237    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.35:6567/health\": dial tcp 10.134.0.35:6567: connect: connection refused"
Sep 17 12:16:39.460795 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:39.460397    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:16:43.446839 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.446807    2571 generic.go:356] "Generic (PLEG): container finished" podID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerID="980e9ebb6e5b5ddc93efe979618e6ad29a11f7454aaf32e937179eb848412f7f" exitCode=137
Sep 17 12:16:43.446839 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.446834    2571 generic.go:356] "Generic (PLEG): container finished" podID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerID="f3bcdf7a0e23a8b2a3c30629120073cef9511bccf560f28bb76f7cfefa0570d5" exitCode=137
Sep 17 12:16:43.447302 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.446874    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"980e9ebb6e5b5ddc93efe979618e6ad29a11f7454aaf32e937179eb848412f7f"}
Sep 17 12:16:43.447302 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.446916    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"f3bcdf7a0e23a8b2a3c30629120073cef9511bccf560f28bb76f7cfefa0570d5"}
Sep 17 12:16:43.449971 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.449951    2571 generic.go:356] "Generic (PLEG): container finished" podID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerID="fd8028c60361528a3a472a6e2920b619135c52ecda4976d0c2fabdcab0d8e757" exitCode=137
Sep 17 12:16:43.450100 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.450027    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerDied","Data":"fd8028c60361528a3a472a6e2920b619135c52ecda4976d0c2fabdcab0d8e757"}
Sep 17 12:16:43.474524 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.474503    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:16:43.572574 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.572516    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
Sep 17 12:16:43.572757 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.572555    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Sep 17 12:16:43.572757 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.572512    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.34:6571: connect: connection refused"
Sep 17 12:16:43.572757 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.572700    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 12:16:43.595622 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.595557    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-online-tls\") pod \"154caedb-df59-4a90-a1cc-971c646d9cfd\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") "
Sep 17 12:16:43.595622 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.595605    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/154caedb-df59-4a90-a1cc-971c646d9cfd-feast-data\") pod \"154caedb-df59-4a90-a1cc-971c646d9cfd\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") "
Sep 17 12:16:43.595807 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.595625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-offline-tls\") pod \"154caedb-df59-4a90-a1cc-971c646d9cfd\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") "
Sep 17 12:16:43.595807 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.595691    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55k7h\" (UniqueName: \"kubernetes.io/projected/154caedb-df59-4a90-a1cc-971c646d9cfd-kube-api-access-55k7h\") pod \"154caedb-df59-4a90-a1cc-971c646d9cfd\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") "
Sep 17 12:16:43.595807 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.595728    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/154caedb-df59-4a90-a1cc-971c646d9cfd-registry-tls\") pod \"154caedb-df59-4a90-a1cc-971c646d9cfd\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") "
Sep 17 12:16:43.595807 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.595759    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-ui-tls\") pod \"154caedb-df59-4a90-a1cc-971c646d9cfd\" (UID: \"154caedb-df59-4a90-a1cc-971c646d9cfd\") "
Sep 17 12:16:43.596238 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.596159    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/154caedb-df59-4a90-a1cc-971c646d9cfd-feast-data" (OuterVolumeSpecName: "feast-data") pod "154caedb-df59-4a90-a1cc-971c646d9cfd" (UID: "154caedb-df59-4a90-a1cc-971c646d9cfd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:16:43.596662 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.596631    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/154caedb-df59-4a90-a1cc-971c646d9cfd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "154caedb-df59-4a90-a1cc-971c646d9cfd" (UID: "154caedb-df59-4a90-a1cc-971c646d9cfd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 12:16:43.600075 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.600046    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "154caedb-df59-4a90-a1cc-971c646d9cfd" (UID: "154caedb-df59-4a90-a1cc-971c646d9cfd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.600180 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.600069    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-online-tls" (OuterVolumeSpecName: "online-tls") pod "154caedb-df59-4a90-a1cc-971c646d9cfd" (UID: "154caedb-df59-4a90-a1cc-971c646d9cfd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.600180 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.600100    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "154caedb-df59-4a90-a1cc-971c646d9cfd" (UID: "154caedb-df59-4a90-a1cc-971c646d9cfd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.600180 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.600115    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/154caedb-df59-4a90-a1cc-971c646d9cfd-kube-api-access-55k7h" (OuterVolumeSpecName: "kube-api-access-55k7h") pod "154caedb-df59-4a90-a1cc-971c646d9cfd" (UID: "154caedb-df59-4a90-a1cc-971c646d9cfd"). InnerVolumeSpecName "kube-api-access-55k7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:16:43.656164 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.656146    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:16:43.696960 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.696939    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55k7h\" (UniqueName: \"kubernetes.io/projected/154caedb-df59-4a90-a1cc-971c646d9cfd-kube-api-access-55k7h\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.696960 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.696958    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/154caedb-df59-4a90-a1cc-971c646d9cfd-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.697085 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.696968    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.697085 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.696998    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.697085 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.697007    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/154caedb-df59-4a90-a1cc-971c646d9cfd-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.697085 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.697014    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/154caedb-df59-4a90-a1cc-971c646d9cfd-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.797638 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.797618    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-offline-tls\") pod \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") "
Sep 17 12:16:43.797737 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.797649    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-ui-tls\") pod \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") "
Sep 17 12:16:43.797737 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.797673    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-feast-data\") pod \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") "
Sep 17 12:16:43.797737 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.797694    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls\") pod \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") "
Sep 17 12:16:43.797931 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.797787    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2fkh\" (UniqueName: \"kubernetes.io/projected/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-kube-api-access-p2fkh\") pod \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") "
Sep 17 12:16:43.797931 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.797829    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-online-tls\") pod \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\" (UID: \"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7\") "
Sep 17 12:16:43.798220 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.798190    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-feast-data" (OuterVolumeSpecName: "feast-data") pod "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:16:43.799890 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.799862    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-online-tls" (OuterVolumeSpecName: "online-tls") pod "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.800424 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.800395    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.800424 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.800408    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-kube-api-access-p2fkh" (OuterVolumeSpecName: "kube-api-access-p2fkh") pod "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7"). InnerVolumeSpecName "kube-api-access-p2fkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:16:43.800541 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.800445    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.800541 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.800467    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" (UID: "c82e38bd-d954-4c5a-ab8a-d1e070cc75f7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:16:43.899018 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.898976    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.899018 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.898995    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.899018 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.899004    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.899018 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.899011    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.899018 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.899019    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2fkh\" (UniqueName: \"kubernetes.io/projected/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-kube-api-access-p2fkh\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:43.899234 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:43.899027    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:16:44.456435 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.456387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d" event={"ID":"c82e38bd-d954-4c5a-ab8a-d1e070cc75f7","Type":"ContainerDied","Data":"bce7addce3575f81c0b27da4292ca248c2711cbff20e896cc7e055abd2e5ef0a"}
Sep 17 12:16:44.456435 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.456398    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"
Sep 17 12:16:44.456435 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.456444    2571 scope.go:117] "RemoveContainer" containerID="dc94b0d76196b5e6830943c8b124315e945a6c5a908a39abcdba010988bf2c15"
Sep 17 12:16:44.459656 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.459634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv" event={"ID":"154caedb-df59-4a90-a1cc-971c646d9cfd","Type":"ContainerDied","Data":"f863217bdd3a4aa7d9b288a828a0ae069c69df8b76c47e2441011b2730dcf50c"}
Sep 17 12:16:44.459656 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.459652    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"
Sep 17 12:16:44.465814 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.465792    2571 scope.go:117] "RemoveContainer" containerID="980e9ebb6e5b5ddc93efe979618e6ad29a11f7454aaf32e937179eb848412f7f"
Sep 17 12:16:44.473376 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.473361    2571 scope.go:117] "RemoveContainer" containerID="39d27af3429600ec4355038463da9e90feba6c9a44ea4b20329745dc91858d4e"
Sep 17 12:16:44.476929 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.476910    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"]
Sep 17 12:16:44.480742 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.480719    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-zgc5d"]
Sep 17 12:16:44.481496 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.481482    2571 scope.go:117] "RemoveContainer" containerID="f3bcdf7a0e23a8b2a3c30629120073cef9511bccf560f28bb76f7cfefa0570d5"
Sep 17 12:16:44.488509 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.488493    2571 scope.go:117] "RemoveContainer" containerID="48eaa62350a5cacd980cb490e8e3b2692f34b2281e4aa70e3d5ec88c83251fd3"
Sep 17 12:16:44.492470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.492450    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"]
Sep 17 12:16:44.496171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.496155    2571 scope.go:117] "RemoveContainer" containerID="51740bf4f974ee2da208101658723a4f2a89df253ff4a4dd628a87250afa205e"
Sep 17 12:16:44.496723 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.496708    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-kc7kv"]
Sep 17 12:16:44.504419 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.504341    2571 scope.go:117] "RemoveContainer" containerID="bbf2c74f6d1fe450ae52563d0e90fb5176e877cb5a20b3bc93e806a67e8ba05c"
Sep 17 12:16:44.511969 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.511951    2571 scope.go:117] "RemoveContainer" containerID="fd8028c60361528a3a472a6e2920b619135c52ecda4976d0c2fabdcab0d8e757"
Sep 17 12:16:44.519097 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.519083    2571 scope.go:117] "RemoveContainer" containerID="bd0b2d04e578d7f3530e29d2666d7237c757b9b1920613b6a0d605a56148f371"
Sep 17 12:16:44.526071 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.526053    2571 scope.go:117] "RemoveContainer" containerID="e20acc8c66408c053767e03e0c538ce70347486e0ffd6cde812d494259e65f0f"
Sep 17 12:16:44.532653 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:44.532640    2571 scope.go:117] "RemoveContainer" containerID="ff94684a85166d724644c87ca19e53e2e610b7d7514505cd0215c8657d303bc4"
Sep 17 12:16:45.832474 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:45.832436    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" path="/var/lib/kubelet/pods/154caedb-df59-4a90-a1cc-971c646d9cfd/volumes"
Sep 17 12:16:45.833043 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:16:45.833024    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" path="/var/lib/kubelet/pods/c82e38bd-d954-4c5a-ab8a-d1e070cc75f7/volumes"
Sep 17 12:17:24.019338 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019294    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"]
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019732    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="feast-init"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019746    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="feast-init"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019761    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="feast-apply"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019791    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="feast-apply"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019801    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019809    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019821    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="feast-init"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019828    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="feast-init"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019845    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019854    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019865    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019873    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019889    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="feast-apply"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019897    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="feast-apply"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019909    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019917    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online"
Sep 17 12:17:24.019919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019925    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019932    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019942    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019952    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019960    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="offline"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.019967    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="offline"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020030    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="online"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020040    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="online"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020050    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="ui"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020061    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="registry"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020070    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c82e38bd-d954-4c5a-ab8a-d1e070cc75f7" containerName="offline"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020079    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="ui"
Sep 17 12:17:24.020749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.020086    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="154caedb-df59-4a90-a1cc-971c646d9cfd" containerName="offline"
Sep 17 12:17:24.023830 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.023811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.029547 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.029487    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 12:17:24.029875 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.029851    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 12:17:24.030058 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.030044    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 12:17:24.030243 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.030230    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 12:17:24.030484 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.030465    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-scwfh\""
Sep 17 12:17:24.031836 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.031818    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 12:17:24.032277 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.032113    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 12:17:24.047408 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.047386    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"]
Sep 17 12:17:24.085792 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.085752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.085904 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.085806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.085904 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.085835    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.085904 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.085860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.085904 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.085885    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcgtd\" (UniqueName: \"kubernetes.io/projected/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-kube-api-access-jcgtd\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.086106 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.085977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.186828 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.186800    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.186939 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.186858    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.186939 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.186887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.186939 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.186915    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.186937    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.187011    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.187013    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.187015    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls podName:87a57e30-27eb-423c-8c9d-80ffa3ecb68f nodeName:}" failed. No retries permitted until 2026-09-17 12:17:24.686994954 +0000 UTC m=+1559.379442464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-b8pqs" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.187080    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls podName:87a57e30-27eb-423c-8c9d-80ffa3ecb68f nodeName:}" failed. No retries permitted until 2026-09-17 12:17:24.687062087 +0000 UTC m=+1559.379509601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-b8pqs" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.187096    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls podName:87a57e30-27eb-423c-8c9d-80ffa3ecb68f nodeName:}" failed. No retries permitted until 2026-09-17 12:17:24.687086385 +0000 UTC m=+1559.379533897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls") pod "feast-simple-feast-setup-57576b8fcf-b8pqs" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:17:24.187109 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.186941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.187466 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.187130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcgtd\" (UniqueName: \"kubernetes.io/projected/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-kube-api-access-jcgtd\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.187466 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.187377    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.189454 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.189429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.195677 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.195653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcgtd\" (UniqueName: \"kubernetes.io/projected/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-kube-api-access-jcgtd\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.691336 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.691311    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.691496 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.691346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.691496 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.691386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.691496 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.691469    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:17:24.691662 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:17:24.691532    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls podName:87a57e30-27eb-423c-8c9d-80ffa3ecb68f nodeName:}" failed. No retries permitted until 2026-09-17 12:17:25.691516044 +0000 UTC m=+1560.383963558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls") pod "feast-simple-feast-setup-57576b8fcf-b8pqs" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:17:24.693825 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.693804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:24.693928 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:24.693828    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:25.698830 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:25.698793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:25.701441 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:25.701417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b8pqs\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:25.847428 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:25.847402    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-scwfh\""
Sep 17 12:17:25.855534 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:25.855515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:26.131334 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:26.131306    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"]
Sep 17 12:17:26.132286 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:17:26.132258    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87a57e30_27eb_423c_8c9d_80ffa3ecb68f.slice/crio-5eeabeb8e159020b4ac2ad45590b66d48b832c14c425c73e957fc2f7de2d0098 WatchSource:0}: Error finding container 5eeabeb8e159020b4ac2ad45590b66d48b832c14c425c73e957fc2f7de2d0098: Status 404 returned error can't find the container with id 5eeabeb8e159020b4ac2ad45590b66d48b832c14c425c73e957fc2f7de2d0098
Sep 17 12:17:26.628720 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:26.628682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"}
Sep 17 12:17:26.628918 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:26.628749    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"5eeabeb8e159020b4ac2ad45590b66d48b832c14c425c73e957fc2f7de2d0098"}
Sep 17 12:17:31.650565 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:31.650524    2571 generic.go:356] "Generic (PLEG): container finished" podID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerID="bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d" exitCode=0
Sep 17 12:17:31.650991 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:31.650577    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"}
Sep 17 12:17:32.656921 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:32.656890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"}
Sep 17 12:17:37.678719 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:37.678636    2571 generic.go:356] "Generic (PLEG): container finished" podID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerID="760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503" exitCode=0
Sep 17 12:17:37.679081 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:37.678710    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"}
Sep 17 12:17:38.690298 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:38.690260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"}
Sep 17 12:17:38.690818 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:38.690321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"}
Sep 17 12:17:38.690818 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:38.690344    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"}
Sep 17 12:17:38.690818 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:38.690362    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerStarted","Data":"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"}
Sep 17 12:17:38.717523 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:38.717462    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podStartSLOduration=15.717440918 podStartE2EDuration="15.717440918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:17:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:17:38.714553227 +0000 UTC m=+1573.407000786" watchObservedRunningTime="2026-09-17 12:17:38.717440918 +0000 UTC m=+1573.409888453"
Sep 17 12:17:40.856802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.856653    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:40.856802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.856711    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:40.856802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.856732    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:40.856802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.856753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:40.859145 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.859110    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
Sep 17 12:17:40.859282 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.859146    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Sep 17 12:17:40.859342 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.859292    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Sep 17 12:17:40.859431 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:40.859129    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.36:8816: connect: connection refused"
Sep 17 12:17:43.856691 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:43.856650    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Sep 17 12:17:43.857324 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:43.856650    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.36:8816: connect: connection refused"
Sep 17 12:17:43.857456 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:43.856650    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
Sep 17 12:17:43.857456 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:43.856671    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Sep 17 12:17:45.855742 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:45.855708    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:45.856130 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:45.855758    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:45.856130 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:45.855786    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:45.856130 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:45.855797    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:46.856077 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:46.856032    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Sep 17 12:17:46.857030 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:46.856812    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:46.857030 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:46.856917    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:46.857623 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:46.857605    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:46.857749 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:46.857663    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:46.862220 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:46.862198    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:47.740741 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:47.740714    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:49.856853 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:49.856824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:17:50.749901 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:17:50.749878    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:18:53.463162 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.463129    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"]
Sep 17 12:18:53.463671 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.463382    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="registry" containerID="cri-o://ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c" gracePeriod=30
Sep 17 12:18:53.463671 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.463497    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" containerID="cri-o://b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34" gracePeriod=30
Sep 17 12:18:53.463671 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.463543    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online" containerID="cri-o://98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac" gracePeriod=30
Sep 17 12:18:53.463671 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.463487    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="offline" containerID="cri-o://c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82" gracePeriod=30
Sep 17 12:18:53.877655 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.877570    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"]
Sep 17 12:18:53.882326 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.882297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:53.884793 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.884751    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xkbfd\""
Sep 17 12:18:53.892051 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.892028    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"]
Sep 17 12:18:53.941170 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.941110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:53.941366 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.941228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:53.941366 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.941302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:53.941366 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.941332    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkfmj\" (UniqueName: \"kubernetes.io/projected/268d05ca-0a60-481b-9206-af24acda3cd9-kube-api-access-zkfmj\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:53.941558 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.941473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/268d05ca-0a60-481b-9206-af24acda3cd9-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:53.941654 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:53.941636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.042794 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.042751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.042951 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.042818    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.042951 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.042848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkfmj\" (UniqueName: \"kubernetes.io/projected/268d05ca-0a60-481b-9206-af24acda3cd9-kube-api-access-zkfmj\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.042951 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.042917    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/268d05ca-0a60-481b-9206-af24acda3cd9-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.042951 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.042942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.043172 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:18:54.042983    2571 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:18:54.043172 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.043003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.043172 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:18:54.043060    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls podName:268d05ca-0a60-481b-9206-af24acda3cd9 nodeName:}" failed. No retries permitted until 2026-09-17 12:18:54.543037554 +0000 UTC m=+1649.235485068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls") pod "feast-simple-feast-setup-57576b8fcf-mdsml" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 12:18:54.043359 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.043334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/268d05ca-0a60-481b-9206-af24acda3cd9-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.045625 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.045560    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.045962 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.045944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.046083 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.046063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.051580 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.051561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkfmj\" (UniqueName: \"kubernetes.io/projected/268d05ca-0a60-481b-9206-af24acda3cd9-kube-api-access-zkfmj\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.546927 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.546851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.549222 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.549204    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mdsml\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:54.795089 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:54.795058    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:18:55.008802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:55.008758    2571 generic.go:356] "Generic (PLEG): container finished" podID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerID="b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34" exitCode=0
Sep 17 12:18:55.008802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:55.008801    2571 generic.go:356] "Generic (PLEG): container finished" podID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerID="98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac" exitCode=0
Sep 17 12:18:55.008985 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:55.008802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"}
Sep 17 12:18:55.008985 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:55.008860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"}
Sep 17 12:18:55.073464 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:55.073447    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"]
Sep 17 12:18:55.075320 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:18:55.075296    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod268d05ca_0a60_481b_9206_af24acda3cd9.slice/crio-cd767e6cb882076fae4d2af5518f24494c289199234a9bd2e29cdb5729f3ca4c WatchSource:0}: Error finding container cd767e6cb882076fae4d2af5518f24494c289199234a9bd2e29cdb5729f3ca4c: Status 404 returned error can't find the container with id cd767e6cb882076fae4d2af5518f24494c289199234a9bd2e29cdb5729f3ca4c
Sep 17 12:18:56.014436 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:56.014406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"428cb65023a21b977f6de0a0f925eee0e9b433992463a5025afab593b65bac16"}
Sep 17 12:18:56.014436 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:56.014447    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"cd767e6cb882076fae4d2af5518f24494c289199234a9bd2e29cdb5729f3ca4c"}
Sep 17 12:18:57.738514 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:18:57.738477    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Sep 17 12:19:00.750267 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:00.750225    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Sep 17 12:19:02.039066 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:02.039034    2571 generic.go:356] "Generic (PLEG): container finished" podID="268d05ca-0a60-481b-9206-af24acda3cd9" containerID="428cb65023a21b977f6de0a0f925eee0e9b433992463a5025afab593b65bac16" exitCode=0
Sep 17 12:19:02.039458 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:02.039095    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"428cb65023a21b977f6de0a0f925eee0e9b433992463a5025afab593b65bac16"}
Sep 17 12:19:03.044597 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:03.044566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"31494a15572cf6884a4386c52f06dcdf01d0c3e924591387674c1895cd1016af"}
Sep 17 12:19:07.738820 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:07.738753    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Sep 17 12:19:08.065638 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:08.065560    2571 generic.go:356] "Generic (PLEG): container finished" podID="268d05ca-0a60-481b-9206-af24acda3cd9" containerID="31494a15572cf6884a4386c52f06dcdf01d0c3e924591387674c1895cd1016af" exitCode=0
Sep 17 12:19:08.065638 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:08.065619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"31494a15572cf6884a4386c52f06dcdf01d0c3e924591387674c1895cd1016af"}
Sep 17 12:19:09.076696 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.076647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"2ed5c68199eaad0f92b59e1e33ca9134c68090dfb706ad576e4697987f4ffd5a"}
Sep 17 12:19:09.077207 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.076712    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"6dabc9c98792bca4a1cd092a44ccea25fa51d70d08335ce21812291ac81eaedb"}
Sep 17 12:19:09.077207 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.076733    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"c12bbe3335d0ad0e18fe1e233cd4edfc7664beac451762a46ecfee3e65c409be"}
Sep 17 12:19:09.077207 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.076751    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerStarted","Data":"570ea64fd0e598596aab0caedce9f05c6c8a4c01e96d94448daa1282c1a74534"}
Sep 17 12:19:09.107500 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.106024    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podStartSLOduration=16.10600093 podStartE2EDuration="16.10600093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:19:09.104646232 +0000 UTC m=+1663.797093772" watchObservedRunningTime="2026-09-17 12:19:09.10600093 +0000 UTC m=+1663.798448487"
Sep 17 12:19:09.795876 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.795834    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:09.796083 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.795901    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:09.796083 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.795922    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:09.796083 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.795938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:09.798078 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.798036    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.37:8816: connect: connection refused"
Sep 17 12:19:09.798333 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.798063    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 17 12:19:09.798462 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.798113    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Sep 17 12:19:09.798462 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:09.798167    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
Sep 17 12:19:10.750294 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:10.750245    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Sep 17 12:19:12.795878 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:12.795832    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
Sep 17 12:19:12.796511 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:12.795865    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 17 12:19:12.796719 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:12.795874    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.37:8816: connect: connection refused"
Sep 17 12:19:12.796719 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:12.795951    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Sep 17 12:19:14.796171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:14.796126    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:14.796688 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:14.796198    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:14.796688 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:14.796223    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:14.796688 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:14.796241    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:15.796506 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:15.796123    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 17 12:19:15.796506 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:15.796201    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Sep 17 12:19:15.797052 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:15.796997    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:15.797112 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:15.797102    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:15.797785 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:15.797736    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:15.797910 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:15.797839    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:17.738150 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:17.738112    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Sep 17 12:19:17.738560 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:17.738240    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:19:18.796383 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:18.796358    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:18.797236 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:18.797215    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:18.801703 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:18.801686    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:19.132874 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:19.132801    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:19:20.750036 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:20.749994    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Sep 17 12:19:20.750488 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:20.750112    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:19:24.107194 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.107169    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:19:24.150520 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150486    2571 generic.go:356] "Generic (PLEG): container finished" podID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerID="c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82" exitCode=137
Sep 17 12:19:24.150520 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150512    2571 generic.go:356] "Generic (PLEG): container finished" podID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerID="ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c" exitCode=137
Sep 17 12:19:24.150717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150551    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"
Sep 17 12:19:24.150717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"}
Sep 17 12:19:24.150717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150610    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"}
Sep 17 12:19:24.150717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150626    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs" event={"ID":"87a57e30-27eb-423c-8c9d-80ffa3ecb68f","Type":"ContainerDied","Data":"5eeabeb8e159020b4ac2ad45590b66d48b832c14c425c73e957fc2f7de2d0098"}
Sep 17 12:19:24.150717 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.150643    2571 scope.go:117] "RemoveContainer" containerID="b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"
Sep 17 12:19:24.158599 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.158582    2571 scope.go:117] "RemoveContainer" containerID="c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"
Sep 17 12:19:24.165841 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.165822    2571 scope.go:117] "RemoveContainer" containerID="98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"
Sep 17 12:19:24.172806 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.172788    2571 scope.go:117] "RemoveContainer" containerID="ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"
Sep 17 12:19:24.179678 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.179662    2571 scope.go:117] "RemoveContainer" containerID="760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"
Sep 17 12:19:24.188315 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.188299    2571 scope.go:117] "RemoveContainer" containerID="bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"
Sep 17 12:19:24.192563 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.192546    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls\") pod \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") "
Sep 17 12:19:24.192661 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.192599    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcgtd\" (UniqueName: \"kubernetes.io/projected/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-kube-api-access-jcgtd\") pod \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") "
Sep 17 12:19:24.192661 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.192640    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-registry-tls\") pod \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") "
Sep 17 12:19:24.192834 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.192670    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") pod \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") "
Sep 17 12:19:24.192834 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.192701    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-feast-data\") pod \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") "
Sep 17 12:19:24.192834 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.192730    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls\") pod \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\" (UID: \"87a57e30-27eb-423c-8c9d-80ffa3ecb68f\") "
Sep 17 12:19:24.193544 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.193491    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-feast-data" (OuterVolumeSpecName: "feast-data") pod "87a57e30-27eb-423c-8c9d-80ffa3ecb68f" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:19:24.194978 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.194944    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "87a57e30-27eb-423c-8c9d-80ffa3ecb68f" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:19:24.195417 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.195392    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls" (OuterVolumeSpecName: "online-tls") pod "87a57e30-27eb-423c-8c9d-80ffa3ecb68f" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:19:24.195417 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.195402    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-kube-api-access-jcgtd" (OuterVolumeSpecName: "kube-api-access-jcgtd") pod "87a57e30-27eb-423c-8c9d-80ffa3ecb68f" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f"). InnerVolumeSpecName "kube-api-access-jcgtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:19:24.195533 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.195467    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "87a57e30-27eb-423c-8c9d-80ffa3ecb68f" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:19:24.195533 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.195524    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "87a57e30-27eb-423c-8c9d-80ffa3ecb68f" (UID: "87a57e30-27eb-423c-8c9d-80ffa3ecb68f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:19:24.196235 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.196209    2571 scope.go:117] "RemoveContainer" containerID="b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"
Sep 17 12:19:24.196506 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:19:24.196488    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34\": container with ID starting with b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34 not found: ID does not exist" containerID="b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"
Sep 17 12:19:24.196575 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.196518    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"} err="failed to get container status \"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34\": rpc error: code = NotFound desc = could not find container \"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34\": container with ID starting with b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34 not found: ID does not exist"
Sep 17 12:19:24.196575 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.196539    2571 scope.go:117] "RemoveContainer" containerID="c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"
Sep 17 12:19:24.196796 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:19:24.196759    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82\": container with ID starting with c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82 not found: ID does not exist" containerID="c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"
Sep 17 12:19:24.196855 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.196802    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"} err="failed to get container status \"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82\": rpc error: code = NotFound desc = could not find container \"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82\": container with ID starting with c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82 not found: ID does not exist"
Sep 17 12:19:24.196855 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.196817    2571 scope.go:117] "RemoveContainer" containerID="98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"
Sep 17 12:19:24.197034 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:19:24.197013    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac\": container with ID starting with 98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac not found: ID does not exist" containerID="98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"
Sep 17 12:19:24.197109 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197037    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"} err="failed to get container status \"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac\": rpc error: code = NotFound desc = could not find container \"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac\": container with ID starting with 98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac not found: ID does not exist"
Sep 17 12:19:24.197109 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197048    2571 scope.go:117] "RemoveContainer" containerID="ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"
Sep 17 12:19:24.197274 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:19:24.197259    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c\": container with ID starting with ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c not found: ID does not exist" containerID="ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"
Sep 17 12:19:24.197322 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197277    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"} err="failed to get container status \"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c\": rpc error: code = NotFound desc = could not find container \"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c\": container with ID starting with ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c not found: ID does not exist"
Sep 17 12:19:24.197322 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197291    2571 scope.go:117] "RemoveContainer" containerID="760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"
Sep 17 12:19:24.197499 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:19:24.197484    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503\": container with ID starting with 760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503 not found: ID does not exist" containerID="760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"
Sep 17 12:19:24.197547 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197503    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"} err="failed to get container status \"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503\": rpc error: code = NotFound desc = could not find container \"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503\": container with ID starting with 760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503 not found: ID does not exist"
Sep 17 12:19:24.197547 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197517    2571 scope.go:117] "RemoveContainer" containerID="bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"
Sep 17 12:19:24.197719 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:19:24.197705    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d\": container with ID starting with bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d not found: ID does not exist" containerID="bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"
Sep 17 12:19:24.197786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197723    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"} err="failed to get container status \"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d\": rpc error: code = NotFound desc = could not find container \"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d\": container with ID starting with bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d not found: ID does not exist"
Sep 17 12:19:24.197786 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.197734    2571 scope.go:117] "RemoveContainer" containerID="b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"
Sep 17 12:19:24.198022 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198004    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34"} err="failed to get container status \"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34\": rpc error: code = NotFound desc = could not find container \"b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34\": container with ID starting with b0457c8cfe9f8adc5c46496edf0997cc525732114e487f8831fb2016b36f9c34 not found: ID does not exist"
Sep 17 12:19:24.198113 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198024    2571 scope.go:117] "RemoveContainer" containerID="c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"
Sep 17 12:19:24.198277 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198259    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82"} err="failed to get container status \"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82\": rpc error: code = NotFound desc = could not find container \"c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82\": container with ID starting with c1bb45354d16dd6b5f492f47e54225a2517e599db51910c7e968c156d6150d82 not found: ID does not exist"
Sep 17 12:19:24.198346 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198278    2571 scope.go:117] "RemoveContainer" containerID="98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"
Sep 17 12:19:24.198487 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198469    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac"} err="failed to get container status \"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac\": rpc error: code = NotFound desc = could not find container \"98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac\": container with ID starting with 98e27e630819cf929d764c1aeb08fb13ca0c296068c43586ee33945927afefac not found: ID does not exist"
Sep 17 12:19:24.198553 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198489    2571 scope.go:117] "RemoveContainer" containerID="ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"
Sep 17 12:19:24.198719 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198701    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c"} err="failed to get container status \"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c\": rpc error: code = NotFound desc = could not find container \"ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c\": container with ID starting with ce5eb8ae5a31fef4da4096386cc4dac941ad3d768059589623af7686980ef67c not found: ID does not exist"
Sep 17 12:19:24.198801 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.198720    2571 scope.go:117] "RemoveContainer" containerID="760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"
Sep 17 12:19:24.199028 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.199009    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503"} err="failed to get container status \"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503\": rpc error: code = NotFound desc = could not find container \"760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503\": container with ID starting with 760b372ba81358c5641578f2ce84887f25e4cb9030b651887f8132030267f503 not found: ID does not exist"
Sep 17 12:19:24.199093 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.199030    2571 scope.go:117] "RemoveContainer" containerID="bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"
Sep 17 12:19:24.199295 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.199278    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d"} err="failed to get container status \"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d\": rpc error: code = NotFound desc = could not find container \"bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d\": container with ID starting with bcc8e5a058faaeda6ef81e9bb9bbcd7f4e199bcb6f54505f14b95a26ab5b712d not found: ID does not exist"
Sep 17 12:19:24.293491 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.293435    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:19:24.293491 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.293454    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:19:24.293491 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.293461    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:19:24.293491 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.293468    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:19:24.293491 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.293476    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:19:24.293491 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.293483    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcgtd\" (UniqueName: \"kubernetes.io/projected/87a57e30-27eb-423c-8c9d-80ffa3ecb68f-kube-api-access-jcgtd\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:19:24.473408 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.473381    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"]
Sep 17 12:19:24.476452 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:24.476428    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b8pqs"]
Sep 17 12:19:25.831968 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:19:25.831939    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" path="/var/lib/kubelet/pods/87a57e30-27eb-423c-8c9d-80ffa3ecb68f/volumes"
Sep 17 12:20:20.606069 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606037    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"]
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606339    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="offline"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606351    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="offline"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606371    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606380    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606388    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606393    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606410    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="feast-apply"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606415    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="feast-apply"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606423    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="feast-init"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606429    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="feast-init"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606436    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="registry"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606442    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="registry"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606492    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="ui"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606502    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="registry"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606507    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="online"
Sep 17 12:20:20.606525 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.606512    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a57e30-27eb-423c-8c9d-80ffa3ecb68f" containerName="offline"
Sep 17 12:20:20.608966 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.608950    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.614664 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.614625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 12:20:20.614848 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.614741    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 12:20:20.614848 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.614743    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 12:20:20.615796 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.615596    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jbgmz\""
Sep 17 12:20:20.615796 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.615621    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 12:20:20.616005 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.615989    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 12:20:20.616079 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.616024    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 12:20:20.632551 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.632529    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"]
Sep 17 12:20:20.672987 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.672969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.673096 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.673013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lmj4\" (UniqueName: \"kubernetes.io/projected/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-kube-api-access-5lmj4\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.673142 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.673087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.673142 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.673118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.673142 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.673140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.673266 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.673241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774145 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774122    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774225 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774173    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774300 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774356 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lmj4\" (UniqueName: \"kubernetes.io/projected/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-kube-api-access-5lmj4\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774415 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774388    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774469 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774469 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.774578 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:20:20.774510    2571 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 17 12:20:20.774637 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:20:20.774591    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls podName:81fb0787-0f4e-4fcd-bbe0-6f96967d0c19 nodeName:}" failed. No retries permitted until 2026-09-17 12:20:21.274565047 +0000 UTC m=+1735.967012563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 17 12:20:20.774986 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.774968    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.777373 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.777349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.777520 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.777502    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:20.784139 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:20.784121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lmj4\" (UniqueName: \"kubernetes.io/projected/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-kube-api-access-5lmj4\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:21.278713 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:21.278671    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:21.281184 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:21.281160    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-xm9w9\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:21.518923 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:21.518893    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:21.795635 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:21.795614    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"]
Sep 17 12:20:21.797302 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:20:21.797278    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81fb0787_0f4e_4fcd_bbe0_6f96967d0c19.slice/crio-8f11f96e749d94cbf2c1fb4d922bf000222fe0d9ea32e7620a221425febdbfab WatchSource:0}: Error finding container 8f11f96e749d94cbf2c1fb4d922bf000222fe0d9ea32e7620a221425febdbfab: Status 404 returned error can't find the container with id 8f11f96e749d94cbf2c1fb4d922bf000222fe0d9ea32e7620a221425febdbfab
Sep 17 12:20:22.380845 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:22.380815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerStarted","Data":"0da73ceb711d41ba7c19de194640a07fc3b996bd17c61c511879893591537aad"}
Sep 17 12:20:22.381012 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:22.380854    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerStarted","Data":"8f11f96e749d94cbf2c1fb4d922bf000222fe0d9ea32e7620a221425febdbfab"}
Sep 17 12:20:28.405005 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:28.404970    2571 generic.go:356] "Generic (PLEG): container finished" podID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerID="0da73ceb711d41ba7c19de194640a07fc3b996bd17c61c511879893591537aad" exitCode=0
Sep 17 12:20:28.405389 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:28.405033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerDied","Data":"0da73ceb711d41ba7c19de194640a07fc3b996bd17c61c511879893591537aad"}
Sep 17 12:20:29.411003 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:29.410971    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerStarted","Data":"902023389a5ac250ed30ab4ab21faab8e91a683a89f06819c11d72a222fd418c"}
Sep 17 12:20:53.512863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:53.512827    2571 generic.go:356] "Generic (PLEG): container finished" podID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerID="902023389a5ac250ed30ab4ab21faab8e91a683a89f06819c11d72a222fd418c" exitCode=0
Sep 17 12:20:53.513336 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:53.512903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerDied","Data":"902023389a5ac250ed30ab4ab21faab8e91a683a89f06819c11d72a222fd418c"}
Sep 17 12:20:54.521373 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:54.521340    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerStarted","Data":"21e782604a66438357c76dbe50b60213dce55f805d0861e84657f097740daffd"}
Sep 17 12:20:54.521373 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:54.521381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerStarted","Data":"441c2186afed6c3160bbb48c3cd6a333e11a2f968e562d18cf256e47d111ebf6"}
Sep 17 12:20:54.521941 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:54.521393    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerStarted","Data":"b1a37ca3baeb7b8dad2959e4b380d52c2620e2ad116804288d3b69a335322aad"}
Sep 17 12:20:54.548388 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:54.548333    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podStartSLOduration=34.548315003 podStartE2EDuration="34.548315003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:20:54.54700964 +0000 UTC m=+1769.239457172" watchObservedRunningTime="2026-09-17 12:20:54.548315003 +0000 UTC m=+1769.240762533"
Sep 17 12:20:57.519631 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:57.519598    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:57.520112 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:57.519716    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:57.520112 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:57.519738    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:20:57.521610 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:57.521584    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.38:8816: connect: connection refused"
Sep 17 12:20:57.521730 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:57.521635    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Sep 17 12:20:57.521730 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:20:57.521581    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Sep 17 12:21:00.519245 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:00.519184    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Sep 17 12:21:00.519724 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:00.519187    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.38:8816: connect: connection refused"
Sep 17 12:21:00.519724 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:00.519197    2571 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Sep 17 12:21:01.519269 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:01.519237    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:01.519269 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:01.519280    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:01.519269 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:01.519292    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:03.520671 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:03.520643    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:03.521080 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:03.520798    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:03.521486 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:03.521462    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:03.521807 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:03.521791    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:04.367365 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:04.367341    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:21:05.308308 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:21:05.308275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:22:05.574931 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:05.574887    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 12:22:06.655070 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.655040    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"]
Sep 17 12:22:06.655559 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.655261    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" containerID="cri-o://b1a37ca3baeb7b8dad2959e4b380d52c2620e2ad116804288d3b69a335322aad" gracePeriod=30
Sep 17 12:22:06.655559 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.655320    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="offline" containerID="cri-o://441c2186afed6c3160bbb48c3cd6a333e11a2f968e562d18cf256e47d111ebf6" gracePeriod=30
Sep 17 12:22:06.655559 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.655322    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui" containerID="cri-o://21e782604a66438357c76dbe50b60213dce55f805d0861e84657f097740daffd" gracePeriod=30
Sep 17 12:22:06.849698 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.849661    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"]
Sep 17 12:22:06.850035 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.849980    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="registry" containerID="cri-o://570ea64fd0e598596aab0caedce9f05c6c8a4c01e96d94448daa1282c1a74534" gracePeriod=30
Sep 17 12:22:06.850276 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.850067    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" containerID="cri-o://c12bbe3335d0ad0e18fe1e233cd4edfc7664beac451762a46ecfee3e65c409be" gracePeriod=30
Sep 17 12:22:06.850412 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.850060    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="offline" containerID="cri-o://6dabc9c98792bca4a1cd092a44ccea25fa51d70d08335ce21812291ac81eaedb" gracePeriod=30
Sep 17 12:22:06.850484 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:06.850082    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" containerID="cri-o://2ed5c68199eaad0f92b59e1e33ca9134c68090dfb706ad576e4697987f4ffd5a" gracePeriod=30
Sep 17 12:22:07.839839 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.839755    2571 generic.go:356] "Generic (PLEG): container finished" podID="268d05ca-0a60-481b-9206-af24acda3cd9" containerID="2ed5c68199eaad0f92b59e1e33ca9134c68090dfb706ad576e4697987f4ffd5a" exitCode=0
Sep 17 12:22:07.839839 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.839801    2571 generic.go:356] "Generic (PLEG): container finished" podID="268d05ca-0a60-481b-9206-af24acda3cd9" containerID="c12bbe3335d0ad0e18fe1e233cd4edfc7664beac451762a46ecfee3e65c409be" exitCode=0
Sep 17 12:22:07.839839 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.839799    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"2ed5c68199eaad0f92b59e1e33ca9134c68090dfb706ad576e4697987f4ffd5a"}
Sep 17 12:22:07.839839 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.839834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"c12bbe3335d0ad0e18fe1e233cd4edfc7664beac451762a46ecfee3e65c409be"}
Sep 17 12:22:07.842428 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.842408    2571 generic.go:356] "Generic (PLEG): container finished" podID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerID="21e782604a66438357c76dbe50b60213dce55f805d0861e84657f097740daffd" exitCode=0
Sep 17 12:22:07.842428 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.842426    2571 generic.go:356] "Generic (PLEG): container finished" podID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerID="b1a37ca3baeb7b8dad2959e4b380d52c2620e2ad116804288d3b69a335322aad" exitCode=0
Sep 17 12:22:07.842560 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.842477    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerDied","Data":"21e782604a66438357c76dbe50b60213dce55f805d0861e84657f097740daffd"}
Sep 17 12:22:07.842560 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:07.842508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerDied","Data":"b1a37ca3baeb7b8dad2959e4b380d52c2620e2ad116804288d3b69a335322aad"}
Sep 17 12:22:08.797836 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:08.797791    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 17 12:22:09.130802 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:09.130702    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Sep 17 12:22:13.522014 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:13.521967    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Sep 17 12:22:14.570829 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:14.570763    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Sep 17 12:22:18.797082 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:18.797032    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 17 12:22:19.130138 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:19.130037    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Sep 17 12:22:23.521870 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:23.521816    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Sep 17 12:22:24.571003 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:24.570957    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Sep 17 12:22:24.571424 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:24.571069    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:22:28.797832 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:28.797788    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Sep 17 12:22:28.798221 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:28.797910    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:22:29.130031 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:29.129937    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Sep 17 12:22:29.130191 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:29.130069    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:22:33.521428 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:33.521372    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Sep 17 12:22:33.521934 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:33.521546    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:22:34.570977 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:34.570935    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Sep 17 12:22:36.958531 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:36.958486    2571 generic.go:356] "Generic (PLEG): container finished" podID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerID="441c2186afed6c3160bbb48c3cd6a333e11a2f968e562d18cf256e47d111ebf6" exitCode=137
Sep 17 12:22:36.958919 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:36.958547    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerDied","Data":"441c2186afed6c3160bbb48c3cd6a333e11a2f968e562d18cf256e47d111ebf6"}
Sep 17 12:22:36.961523 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:36.961497    2571 generic.go:356] "Generic (PLEG): container finished" podID="268d05ca-0a60-481b-9206-af24acda3cd9" containerID="6dabc9c98792bca4a1cd092a44ccea25fa51d70d08335ce21812291ac81eaedb" exitCode=137
Sep 17 12:22:36.961523 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:36.961518    2571 generic.go:356] "Generic (PLEG): container finished" podID="268d05ca-0a60-481b-9206-af24acda3cd9" containerID="570ea64fd0e598596aab0caedce9f05c6c8a4c01e96d94448daa1282c1a74534" exitCode=137
Sep 17 12:22:36.961664 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:36.961553    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"6dabc9c98792bca4a1cd092a44ccea25fa51d70d08335ce21812291ac81eaedb"}
Sep 17 12:22:36.961664 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:36.961578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"570ea64fd0e598596aab0caedce9f05c6c8a4c01e96d94448daa1282c1a74534"}
Sep 17 12:22:37.306935 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.306910    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:22:37.476912 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.476894    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lmj4\" (UniqueName: \"kubernetes.io/projected/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-kube-api-access-5lmj4\") pod \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") "
Sep 17 12:22:37.477060 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.476923    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-feast-data\") pod \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") "
Sep 17 12:22:37.477060 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.476947    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls\") pod \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") "
Sep 17 12:22:37.477060 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.476999    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-registry-tls\") pod \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") "
Sep 17 12:22:37.477060 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.477021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-offline-tls\") pod \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") "
Sep 17 12:22:37.477284 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.477089    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-online-tls\") pod \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\" (UID: \"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19\") "
Sep 17 12:22:37.477508 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.477462    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-feast-data" (OuterVolumeSpecName: "feast-data") pod "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:22:37.477508 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.477482    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 12:22:37.479485 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.479452    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.479588 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.479504    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-kube-api-access-5lmj4" (OuterVolumeSpecName: "kube-api-access-5lmj4") pod "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19"). InnerVolumeSpecName "kube-api-access-5lmj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:22:37.479588 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.479515    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-online-tls" (OuterVolumeSpecName: "online-tls") pod "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.479588 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.479535    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" (UID: "81fb0787-0f4e-4fcd-bbe0-6f96967d0c19"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.481755 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.481740    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:22:37.577801 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.577781    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-ui-tls\") pod \"268d05ca-0a60-481b-9206-af24acda3cd9\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") "
Sep 17 12:22:37.577910 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.577810    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-offline-tls\") pod \"268d05ca-0a60-481b-9206-af24acda3cd9\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") "
Sep 17 12:22:37.577910 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.577839    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/268d05ca-0a60-481b-9206-af24acda3cd9-feast-data\") pod \"268d05ca-0a60-481b-9206-af24acda3cd9\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") "
Sep 17 12:22:37.577910 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.577879    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls\") pod \"268d05ca-0a60-481b-9206-af24acda3cd9\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") "
Sep 17 12:22:37.577910 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.577902    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-registry-tls\") pod \"268d05ca-0a60-481b-9206-af24acda3cd9\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") "
Sep 17 12:22:37.578077 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.577964    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkfmj\" (UniqueName: \"kubernetes.io/projected/268d05ca-0a60-481b-9206-af24acda3cd9-kube-api-access-zkfmj\") pod \"268d05ca-0a60-481b-9206-af24acda3cd9\" (UID: \"268d05ca-0a60-481b-9206-af24acda3cd9\") "
Sep 17 12:22:37.578178 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578148    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.578178 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578172    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.578361 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578186    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.578361 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578200    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lmj4\" (UniqueName: \"kubernetes.io/projected/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-kube-api-access-5lmj4\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.578361 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578214    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.578361 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578227    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.578540 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.578411    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/268d05ca-0a60-481b-9206-af24acda3cd9-feast-data" (OuterVolumeSpecName: "feast-data") pod "268d05ca-0a60-481b-9206-af24acda3cd9" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:22:37.579923 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.579902    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls" (OuterVolumeSpecName: "online-tls") pod "268d05ca-0a60-481b-9206-af24acda3cd9" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.580500 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.580478    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "268d05ca-0a60-481b-9206-af24acda3cd9" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.580579 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.580503    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "268d05ca-0a60-481b-9206-af24acda3cd9" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.580696 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.580678    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "268d05ca-0a60-481b-9206-af24acda3cd9" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 12:22:37.580788 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.580705    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/268d05ca-0a60-481b-9206-af24acda3cd9-kube-api-access-zkfmj" (OuterVolumeSpecName: "kube-api-access-zkfmj") pod "268d05ca-0a60-481b-9206-af24acda3cd9" (UID: "268d05ca-0a60-481b-9206-af24acda3cd9"). InnerVolumeSpecName "kube-api-access-zkfmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:22:37.679313 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.679289    2571 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-online-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.679313 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.679311    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-registry-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.679426 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.679320    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkfmj\" (UniqueName: \"kubernetes.io/projected/268d05ca-0a60-481b-9206-af24acda3cd9-kube-api-access-zkfmj\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.679426 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.679330    2571 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-ui-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.679426 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.679338    2571 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/268d05ca-0a60-481b-9206-af24acda3cd9-offline-tls\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.679426 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.679347    2571 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/268d05ca-0a60-481b-9206-af24acda3cd9-feast-data\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:22:37.969116 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.969091    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"
Sep 17 12:22:37.969474 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.969111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml" event={"ID":"268d05ca-0a60-481b-9206-af24acda3cd9","Type":"ContainerDied","Data":"cd767e6cb882076fae4d2af5518f24494c289199234a9bd2e29cdb5729f3ca4c"}
Sep 17 12:22:37.969474 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.969191    2571 scope.go:117] "RemoveContainer" containerID="2ed5c68199eaad0f92b59e1e33ca9134c68090dfb706ad576e4697987f4ffd5a"
Sep 17 12:22:37.972736 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.972713    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9" event={"ID":"81fb0787-0f4e-4fcd-bbe0-6f96967d0c19","Type":"ContainerDied","Data":"8f11f96e749d94cbf2c1fb4d922bf000222fe0d9ea32e7620a221425febdbfab"}
Sep 17 12:22:37.972872 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.972748    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"
Sep 17 12:22:37.979658 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.979637    2571 scope.go:117] "RemoveContainer" containerID="6dabc9c98792bca4a1cd092a44ccea25fa51d70d08335ce21812291ac81eaedb"
Sep 17 12:22:37.987849 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.987832    2571 scope.go:117] "RemoveContainer" containerID="c12bbe3335d0ad0e18fe1e233cd4edfc7664beac451762a46ecfee3e65c409be"
Sep 17 12:22:37.989224 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.989203    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"]
Sep 17 12:22:37.992407 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.992384    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mdsml"]
Sep 17 12:22:37.996257 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:37.996237    2571 scope.go:117] "RemoveContainer" containerID="570ea64fd0e598596aab0caedce9f05c6c8a4c01e96d94448daa1282c1a74534"
Sep 17 12:22:38.003843 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.003825    2571 scope.go:117] "RemoveContainer" containerID="31494a15572cf6884a4386c52f06dcdf01d0c3e924591387674c1895cd1016af"
Sep 17 12:22:38.008883 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.008861    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"]
Sep 17 12:22:38.011796 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.011749    2571 scope.go:117] "RemoveContainer" containerID="428cb65023a21b977f6de0a0f925eee0e9b433992463a5025afab593b65bac16"
Sep 17 12:22:38.012391 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.012372    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-xm9w9"]
Sep 17 12:22:38.019366 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.019346    2571 scope.go:117] "RemoveContainer" containerID="21e782604a66438357c76dbe50b60213dce55f805d0861e84657f097740daffd"
Sep 17 12:22:38.026635 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.026620    2571 scope.go:117] "RemoveContainer" containerID="441c2186afed6c3160bbb48c3cd6a333e11a2f968e562d18cf256e47d111ebf6"
Sep 17 12:22:38.034377 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.034363    2571 scope.go:117] "RemoveContainer" containerID="b1a37ca3baeb7b8dad2959e4b380d52c2620e2ad116804288d3b69a335322aad"
Sep 17 12:22:38.041512 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.041494    2571 scope.go:117] "RemoveContainer" containerID="902023389a5ac250ed30ab4ab21faab8e91a683a89f06819c11d72a222fd418c"
Sep 17 12:22:38.048279 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:38.048263    2571 scope.go:117] "RemoveContainer" containerID="0da73ceb711d41ba7c19de194640a07fc3b996bd17c61c511879893591537aad"
Sep 17 12:22:39.832791 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:39.832745    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" path="/var/lib/kubelet/pods/268d05ca-0a60-481b-9206-af24acda3cd9/volumes"
Sep 17 12:22:39.833412 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:39.833393    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" path="/var/lib/kubelet/pods/81fb0787-0f4e-4fcd-bbe0-6f96967d0c19/volumes"
Sep 17 12:22:55.666738 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.666704    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpq69/must-gather-qhdjt"]
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667054    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667068    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667081    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667087    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667094    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="feast-apply"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667100    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="feast-apply"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667106    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="offline"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667112    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="offline"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667120    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="feast-init"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667125    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="feast-init"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667131    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667136    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667142    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="feast-apply"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667147    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="feast-apply"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667153    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="registry"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667158    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="registry"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667163    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="feast-init"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667167    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="feast-init"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667175    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="offline"
Sep 17 12:22:55.667171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667180    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="offline"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667189    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667194    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667241    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="offline"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667249    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="registry"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667254    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="online"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667260    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="offline"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667264    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="ui"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667270    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="81fb0787-0f4e-4fcd-bbe0-6f96967d0c19" containerName="online"
Sep 17 12:22:55.667950 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.667274    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="268d05ca-0a60-481b-9206-af24acda3cd9" containerName="ui"
Sep 17 12:22:55.672175 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.672155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.674461 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.674441    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpq69\"/\"kube-root-ca.crt\""
Sep 17 12:22:55.675433 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.675411    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpq69\"/\"default-dockercfg-gklsn\""
Sep 17 12:22:55.675433 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.675421    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpq69\"/\"openshift-service-ca.crt\""
Sep 17 12:22:55.681095 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.681071    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpq69/must-gather-qhdjt"]
Sep 17 12:22:55.701852 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.701834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04d72f53-2d28-4518-990c-fcd3198960c3-must-gather-output\") pod \"must-gather-qhdjt\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") " pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.701947 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.701891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g427\" (UniqueName: \"kubernetes.io/projected/04d72f53-2d28-4518-990c-fcd3198960c3-kube-api-access-4g427\") pod \"must-gather-qhdjt\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") " pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.802459 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.802436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g427\" (UniqueName: \"kubernetes.io/projected/04d72f53-2d28-4518-990c-fcd3198960c3-kube-api-access-4g427\") pod \"must-gather-qhdjt\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") " pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.802542 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.802478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04d72f53-2d28-4518-990c-fcd3198960c3-must-gather-output\") pod \"must-gather-qhdjt\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") " pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.802721 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.802708    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04d72f53-2d28-4518-990c-fcd3198960c3-must-gather-output\") pod \"must-gather-qhdjt\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") " pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.811306 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.811290    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g427\" (UniqueName: \"kubernetes.io/projected/04d72f53-2d28-4518-990c-fcd3198960c3-kube-api-access-4g427\") pod \"must-gather-qhdjt\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") " pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:55.993604 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:55.993570    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:22:56.261237 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:56.261174    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpq69/must-gather-qhdjt"]
Sep 17 12:22:56.265174 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:22:56.265135    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04d72f53_2d28_4518_990c_fcd3198960c3.slice/crio-61106ed063c58c854eb135275252393beedd69015ac6cb9f8c1cd83b368d1d11 WatchSource:0}: Error finding container 61106ed063c58c854eb135275252393beedd69015ac6cb9f8c1cd83b368d1d11: Status 404 returned error can't find the container with id 61106ed063c58c854eb135275252393beedd69015ac6cb9f8c1cd83b368d1d11
Sep 17 12:22:56.267294 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:56.267275    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 12:22:57.057736 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:22:57.057691    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpq69/must-gather-qhdjt" event={"ID":"04d72f53-2d28-4518-990c-fcd3198960c3","Type":"ContainerStarted","Data":"61106ed063c58c854eb135275252393beedd69015ac6cb9f8c1cd83b368d1d11"}
Sep 17 12:23:03.089548 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:03.089509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpq69/must-gather-qhdjt" event={"ID":"04d72f53-2d28-4518-990c-fcd3198960c3","Type":"ContainerStarted","Data":"6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe"}
Sep 17 12:23:03.089548 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:03.089552    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpq69/must-gather-qhdjt" event={"ID":"04d72f53-2d28-4518-990c-fcd3198960c3","Type":"ContainerStarted","Data":"4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"}
Sep 17 12:23:03.109541 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:03.109497    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wpq69/must-gather-qhdjt" podStartSLOduration=1.853141055 podStartE2EDuration="8.109483609s" totalImagesPullingTime="6.256342554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:23:03.108386554 +0000 UTC m=+1897.800834088" watchObservedRunningTime="2026-09-17 12:23:03.109483609 +0000 UTC m=+1897.801931139"
Sep 17 12:23:12.128164 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:12.128133    2571 generic.go:356] "Generic (PLEG): container finished" podID="04d72f53-2d28-4518-990c-fcd3198960c3" containerID="4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0" exitCode=0
Sep 17 12:23:12.128632 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:12.128212    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpq69/must-gather-qhdjt" event={"ID":"04d72f53-2d28-4518-990c-fcd3198960c3","Type":"ContainerDied","Data":"4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"}
Sep 17 12:23:12.128632 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:12.128589    2571 scope.go:117] "RemoveContainer" containerID="4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"
Sep 17 12:23:13.069068 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:13.069030    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wpq69_must-gather-qhdjt_04d72f53-2d28-4518-990c-fcd3198960c3/gather/0.log"
Sep 17 12:23:16.315048 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:16.315016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n7lj9_c979f41e-7d67-4120-be8f-ab41e67cfc71/global-pull-secret-syncer/0.log"
Sep 17 12:23:16.425887 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:16.425848    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rphmw_79a943e6-502a-4942-b4a5-bf052fcba819/konnectivity-agent/0.log"
Sep 17 12:23:16.490171 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:16.490143    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-23.ec2.internal_d26798fc08046ac5b88fca666bd8d47f/haproxy/0.log"
Sep 17 12:23:18.378185 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.378139    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wpq69/must-gather-qhdjt"]
Sep 17 12:23:18.378631 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.378365    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-wpq69/must-gather-qhdjt" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="copy" containerID="cri-o://6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe" gracePeriod=2
Sep 17 12:23:18.380809 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:23:18.380743    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qhdjt\" is forbidden: User \"system:node:ip-10-0-142-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wpq69\": no relationship found between node 'ip-10-0-142-23.ec2.internal' and this object" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:23:18.381706 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.381672    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wpq69/must-gather-qhdjt"]
Sep 17 12:23:18.619826 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.619805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wpq69_must-gather-qhdjt_04d72f53-2d28-4518-990c-fcd3198960c3/copy/0.log"
Sep 17 12:23:18.621596 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.621579    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:23:18.623623 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:23:18.623600    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qhdjt\" is forbidden: User \"system:node:ip-10-0-142-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wpq69\": no relationship found between node 'ip-10-0-142-23.ec2.internal' and this object" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:23:18.686167 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.686110    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g427\" (UniqueName: \"kubernetes.io/projected/04d72f53-2d28-4518-990c-fcd3198960c3-kube-api-access-4g427\") pod \"04d72f53-2d28-4518-990c-fcd3198960c3\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") "
Sep 17 12:23:18.686259 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.686192    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04d72f53-2d28-4518-990c-fcd3198960c3-must-gather-output\") pod \"04d72f53-2d28-4518-990c-fcd3198960c3\" (UID: \"04d72f53-2d28-4518-990c-fcd3198960c3\") "
Sep 17 12:23:18.686529 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.686507    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04d72f53-2d28-4518-990c-fcd3198960c3-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "04d72f53-2d28-4518-990c-fcd3198960c3" (UID: "04d72f53-2d28-4518-990c-fcd3198960c3"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 12:23:18.688386 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.688361    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d72f53-2d28-4518-990c-fcd3198960c3-kube-api-access-4g427" (OuterVolumeSpecName: "kube-api-access-4g427") pod "04d72f53-2d28-4518-990c-fcd3198960c3" (UID: "04d72f53-2d28-4518-990c-fcd3198960c3"). InnerVolumeSpecName "kube-api-access-4g427". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 12:23:18.787469 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.787444    2571 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/04d72f53-2d28-4518-990c-fcd3198960c3-must-gather-output\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:23:18.787469 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:18.787468    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g427\" (UniqueName: \"kubernetes.io/projected/04d72f53-2d28-4518-990c-fcd3198960c3-kube-api-access-4g427\") on node \"ip-10-0-142-23.ec2.internal\" DevicePath \"\""
Sep 17 12:23:19.156470 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.156445    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wpq69_must-gather-qhdjt_04d72f53-2d28-4518-990c-fcd3198960c3/copy/0.log"
Sep 17 12:23:19.156837 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.156812    2571 generic.go:356] "Generic (PLEG): container finished" podID="04d72f53-2d28-4518-990c-fcd3198960c3" containerID="6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe" exitCode=143
Sep 17 12:23:19.156900 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.156860    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:23:19.156938 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.156909    2571 scope.go:117] "RemoveContainer" containerID="6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe"
Sep 17 12:23:19.159428 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:23:19.159402    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qhdjt\" is forbidden: User \"system:node:ip-10-0-142-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wpq69\": no relationship found between node 'ip-10-0-142-23.ec2.internal' and this object" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:23:19.165092 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.165074    2571 scope.go:117] "RemoveContainer" containerID="4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"
Sep 17 12:23:19.166395 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:23:19.166371    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-qhdjt\" is forbidden: User \"system:node:ip-10-0-142-23.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wpq69\": no relationship found between node 'ip-10-0-142-23.ec2.internal' and this object" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" pod="openshift-must-gather-wpq69/must-gather-qhdjt"
Sep 17 12:23:19.175526 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.175509    2571 scope.go:117] "RemoveContainer" containerID="6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe"
Sep 17 12:23:19.175805 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:23:19.175786    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe\": container with ID starting with 6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe not found: ID does not exist" containerID="6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe"
Sep 17 12:23:19.175859 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.175813    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe"} err="failed to get container status \"6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe\": rpc error: code = NotFound desc = could not find container \"6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe\": container with ID starting with 6c175553372a19e8595dc4977c64bca97d2bcf3ec45f0c3597d37658bd31edbe not found: ID does not exist"
Sep 17 12:23:19.175859 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.175829    2571 scope.go:117] "RemoveContainer" containerID="4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"
Sep 17 12:23:19.176071 ip-10-0-142-23 kubenswrapper[2571]: E0917 12:23:19.176055    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0\": container with ID starting with 4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0 not found: ID does not exist" containerID="4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"
Sep 17 12:23:19.176115 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.176077    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0"} err="failed to get container status \"4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0\": rpc error: code = NotFound desc = could not find container \"4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0\": container with ID starting with 4621070d5270a461d13874f2edf7910590e0eb8df0b9409ab2e2e9ebd0b1aae0 not found: ID does not exist"
Sep 17 12:23:19.832397 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:19.832367    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" path="/var/lib/kubelet/pods/04d72f53-2d28-4518-990c-fcd3198960c3/volumes"
Sep 17 12:23:20.400520 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.400489    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/alertmanager/0.log"
Sep 17 12:23:20.424983 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.424951    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/config-reloader/0.log"
Sep 17 12:23:20.452758 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.452738    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/kube-rbac-proxy-web/0.log"
Sep 17 12:23:20.482226 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.482211    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/kube-rbac-proxy/0.log"
Sep 17 12:23:20.515485 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.515449    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/kube-rbac-proxy-metric/0.log"
Sep 17 12:23:20.544953 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.544932    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/prom-label-proxy/0.log"
Sep 17 12:23:20.569125 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.569104    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_01eb78c5-e8b0-425b-8751-e06c732a8642/init-config-reloader/0.log"
Sep 17 12:23:20.960983 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.960963    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmmzx_816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4/node-exporter/0.log"
Sep 17 12:23:20.984973 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:20.984949    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmmzx_816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4/kube-rbac-proxy/0.log"
Sep 17 12:23:21.013863 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.013844    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mmmzx_816e77fa-b096-4ef8-b2fa-ab28fbcfc4d4/init-textfile/0.log"
Sep 17 12:23:21.048083 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.048065    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-gjp7k_17e5fade-967a-4237-8d81-2ed4a986b8a3/kube-rbac-proxy-main/0.log"
Sep 17 12:23:21.072444 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.072428    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-gjp7k_17e5fade-967a-4237-8d81-2ed4a986b8a3/kube-rbac-proxy-self/0.log"
Sep 17 12:23:21.098738 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.098719    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-gjp7k_17e5fade-967a-4237-8d81-2ed4a986b8a3/openshift-state-metrics/0.log"
Sep 17 12:23:21.470614 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.470590    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b49698d4b-slqg9_899f222b-676e-4060-b1c9-7a8be61fd290/telemeter-client/0.log"
Sep 17 12:23:21.504286 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.504257    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b49698d4b-slqg9_899f222b-676e-4060-b1c9-7a8be61fd290/reload/0.log"
Sep 17 12:23:21.530312 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:21.530284    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b49698d4b-slqg9_899f222b-676e-4060-b1c9-7a8be61fd290/kube-rbac-proxy/0.log"
Sep 17 12:23:22.775064 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:22.775039    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-nrghd_c243b463-b1c4-4af9-bc95-ce6e3f9f93f9/networking-console-plugin/0.log"
Sep 17 12:23:23.549721 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.549673    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"]
Sep 17 12:23:23.550117 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.550095    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="copy"
Sep 17 12:23:23.550227 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.550121    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="copy"
Sep 17 12:23:23.550227 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.550144    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="gather"
Sep 17 12:23:23.550227 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.550152    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="gather"
Sep 17 12:23:23.550392 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.550244    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="copy"
Sep 17 12:23:23.550392 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.550260    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d72f53-2d28-4518-990c-fcd3198960c3" containerName="gather"
Sep 17 12:23:23.554302 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.554275    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.556748 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.556725    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f59bn\"/\"default-dockercfg-cmmv6\""
Sep 17 12:23:23.556972 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.556952    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f59bn\"/\"kube-root-ca.crt\""
Sep 17 12:23:23.557742 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.557724    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f59bn\"/\"openshift-service-ca.crt\""
Sep 17 12:23:23.563915 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.563892    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"]
Sep 17 12:23:23.623688 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.623662    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-proc\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.623817 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.623693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxv5g\" (UniqueName: \"kubernetes.io/projected/777ba13e-1c6a-4769-b868-498eabf2c440-kube-api-access-jxv5g\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.623817 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.623714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-sys\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.623817 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.623731    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-lib-modules\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.623817 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.623750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-podres\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.724911 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.724892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-proc\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.724994 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.724921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxv5g\" (UniqueName: \"kubernetes.io/projected/777ba13e-1c6a-4769-b868-498eabf2c440-kube-api-access-jxv5g\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.724994 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.724940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-sys\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.724994 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.724954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-lib-modules\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.725158 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.725031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-proc\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.725158 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.725057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-lib-modules\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.725158 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.725034    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-sys\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.725158 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.725098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-podres\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.725294 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.725204    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/777ba13e-1c6a-4769-b868-498eabf2c440-podres\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.733267 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.733244    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxv5g\" (UniqueName: \"kubernetes.io/projected/777ba13e-1c6a-4769-b868-498eabf2c440-kube-api-access-jxv5g\") pod \"perf-node-gather-daemonset-jc84j\" (UID: \"777ba13e-1c6a-4769-b868-498eabf2c440\") " pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:23.865662 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:23.865585    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:24.135989 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:24.135960    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"]
Sep 17 12:23:24.138669 ip-10-0-142-23 kubenswrapper[2571]: W0917 12:23:24.138641    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod777ba13e_1c6a_4769_b868_498eabf2c440.slice/crio-0af3998ae62482fd0108141aabf8a7249260c4e598161a51ddc4956501bc84df WatchSource:0}: Error finding container 0af3998ae62482fd0108141aabf8a7249260c4e598161a51ddc4956501bc84df: Status 404 returned error can't find the container with id 0af3998ae62482fd0108141aabf8a7249260c4e598161a51ddc4956501bc84df
Sep 17 12:23:24.178571 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:24.178545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j" event={"ID":"777ba13e-1c6a-4769-b868-498eabf2c440","Type":"ContainerStarted","Data":"0af3998ae62482fd0108141aabf8a7249260c4e598161a51ddc4956501bc84df"}
Sep 17 12:23:24.929201 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:24.929180    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvjnx_d5b6bbbd-5113-4e38-9a9d-193c7b39306a/dns/0.log"
Sep 17 12:23:24.957921 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:24.957897    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xvjnx_d5b6bbbd-5113-4e38-9a9d-193c7b39306a/kube-rbac-proxy/0.log"
Sep 17 12:23:25.008067 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:25.008049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tbqrr_a0295d97-4c7e-4d87-864c-ff949309f483/dns-node-resolver/0.log"
Sep 17 12:23:25.184782 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:25.184706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j" event={"ID":"777ba13e-1c6a-4769-b868-498eabf2c440","Type":"ContainerStarted","Data":"e2a085095f5580f122ef85051f529d75468862134d163bc68a8a6776eb700a41"}
Sep 17 12:23:25.184881 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:25.184845    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:25.201912 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:25.201868    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j" podStartSLOduration=2.2018550709999998 podStartE2EDuration="2.201855071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 12:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:23:25.200355574 +0000 UTC m=+1919.892803104" watchObservedRunningTime="2026-09-17 12:23:25.201855071 +0000 UTC m=+1919.894302600"
Sep 17 12:23:25.412044 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:25.412016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78c8895ff4-htrmk_cc4eb549-9a8b-4a51-8696-5c51d8dcc4b9/registry/0.log"
Sep 17 12:23:25.439706 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:25.439656    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4vxzb_cdc9e219-6385-4468-a438-8ee1c63bde48/node-ca/0.log"
Sep 17 12:23:26.490809 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:26.490785    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7mrjt_8cd40895-ffa6-4b22-9b09-9bce5aaa2adb/serve-healthcheck-canary/0.log"
Sep 17 12:23:26.852144 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:26.852068    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-g7q5c_4f2f6688-39b7-4147-bd59-c824eb0cd0bc/insights-operator/0.log"
Sep 17 12:23:26.852144 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:26.852099    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-g7q5c_4f2f6688-39b7-4147-bd59-c824eb0cd0bc/insights-operator/1.log"
Sep 17 12:23:27.005856 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:27.005832    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcptd_af079eaa-0d41-4cf8-9e3c-6bdac91bbc87/kube-rbac-proxy/0.log"
Sep 17 12:23:27.027608 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:27.027586    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcptd_af079eaa-0d41-4cf8-9e3c-6bdac91bbc87/exporter/0.log"
Sep 17 12:23:27.050845 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:27.050813    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcptd_af079eaa-0d41-4cf8-9e3c-6bdac91bbc87/extractor/0.log"
Sep 17 12:23:31.044640 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:31.044539    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vgdcw_1afb88ea-16fc-4ae1-a800-81eaf4e4f52a/migrator/0.log"
Sep 17 12:23:31.064581 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:31.064563    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-vgdcw_1afb88ea-16fc-4ae1-a800-81eaf4e4f52a/graceful-termination/0.log"
Sep 17 12:23:31.199234 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:31.199211    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f59bn/perf-node-gather-daemonset-jc84j"
Sep 17 12:23:31.351054 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:31.350988    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-t6wm7_d1e9d6e2-b146-40c1-8740-26cf574398b5/kube-storage-version-migrator-operator/1.log"
Sep 17 12:23:31.351939 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:31.351901    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-t6wm7_d1e9d6e2-b146-40c1-8740-26cf574398b5/kube-storage-version-migrator-operator/0.log"
Sep 17 12:23:32.230153 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.230128    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/kube-multus-additional-cni-plugins/0.log"
Sep 17 12:23:32.254502 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.254484    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/egress-router-binary-copy/0.log"
Sep 17 12:23:32.278388 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.278371    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/cni-plugins/0.log"
Sep 17 12:23:32.302428 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.302408    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/bond-cni-plugin/0.log"
Sep 17 12:23:32.331158 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.331145    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/routeoverride-cni/0.log"
Sep 17 12:23:32.352850 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.352831    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/whereabouts-cni-bincopy/0.log"
Sep 17 12:23:32.377263 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.377244    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n4w2c_5aa4570a-8a52-4cb8-b8da-c8313aab0cc1/whereabouts-cni/0.log"
Sep 17 12:23:32.856089 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.856019    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xnrck_0c3edc87-bb14-4df4-970a-8c5eb5ec9621/kube-multus/0.log"
Sep 17 12:23:32.878882 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.878853    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2hdbd_ab3f4936-192b-45e9-bf37-03bc8928f2fa/network-metrics-daemon/0.log"
Sep 17 12:23:32.902626 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:32.902606    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2hdbd_ab3f4936-192b-45e9-bf37-03bc8928f2fa/kube-rbac-proxy/0.log"
Sep 17 12:23:33.735710 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.735686    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/ovn-controller/0.log"
Sep 17 12:23:33.755720 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.755703    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/ovn-acl-logging/0.log"
Sep 17 12:23:33.780045 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.780026    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/kube-rbac-proxy-node/0.log"
Sep 17 12:23:33.803571 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.803548    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 12:23:33.824107 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.824082    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/northd/0.log"
Sep 17 12:23:33.845518 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.845500    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/nbdb/0.log"
Sep 17 12:23:33.866307 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.866282    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/sbdb/0.log"
Sep 17 12:23:33.903349 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:33.903330    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9kddg_9f8928c0-2147-4a38-9c66-9a81859566e7/ovnkube-controller/0.log"
Sep 17 12:23:35.271995 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:35.271955    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jxvq8_9ee48424-7ced-43b6-b473-b6de22e6b53f/network-check-target-container/0.log"
Sep 17 12:23:36.183880 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:36.183849    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-s6fpx_cb96907f-98a2-49a8-9e2f-95896d3951ba/iptables-alerter/0.log"
Sep 17 12:23:36.847689 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:36.847661    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-dqdmp_1a4ccec6-1194-4767-a950-5202100a5700/tuned/0.log"
Sep 17 12:23:39.488300 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:39.488267    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-9pd7h_fdddb6e7-7c33-48e4-858c-8d14ac25e2f3/service-ca-operator/1.log"
Sep 17 12:23:39.489416 ip-10-0-142-23 kubenswrapper[2571]: I0917 12:23:39.489395    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-9pd7h_fdddb6e7-7c33-48e4-858c-8d14ac25e2f3/service-ca-operator/0.log"