Sep 17 09:29:53.359755 ip-10-0-135-161 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 09:29:53.728927 ip-10-0-135-161 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 09:29:53.728927 ip-10-0-135-161 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 09:29:53.728927 ip-10-0-135-161 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 09:29:53.728927 ip-10-0-135-161 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 09:29:53.728927 ip-10-0-135-161 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 09:29:53.731378 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.731289    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 09:29:53.737011 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.736996    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 09:29:53.737011 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737012    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737016    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737020    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737023    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737026    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737029    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737032    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737035    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737042    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737045    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737048    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737051    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737053    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737056    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737059    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737062    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737064    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737067    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737070    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737073    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 09:29:53.737077 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737075    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737078    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737081    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737085    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737089    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737096    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737101    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737105    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737111    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737115    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737118    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737123    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737126    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737128    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737131    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737134    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737136    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737139    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737141    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737144    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 09:29:53.737554 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737147    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737150    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737153    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737155    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737157    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737160    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737163    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737165    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737168    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737172    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737175    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737180    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737182    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737186    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737189    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737192    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737194    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737197    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737200    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 09:29:53.738069 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737202    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737206    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737209    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737212    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737216    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737219    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737222    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737224    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737227    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737229    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737232    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737234    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737237    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737240    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737243    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737245    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737248    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737250    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737253    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 09:29:53.738582 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737256    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737259    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737261    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737264    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737267    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737269    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737272    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737274    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737277    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737280    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737282    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737285    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737287    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737290    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737292    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737295    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737297    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737300    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737302    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737305    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 09:29:53.739036 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.737997    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738003    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738006    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738009    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738012    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738015    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738018    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738020    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738024    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738027    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738030    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738032    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738035    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738038    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738041    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738043    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738046    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738048    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738051    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738054    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 09:29:53.739531 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738057    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738060    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738063    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738065    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738068    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738071    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738074    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738077    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738080    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738083    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738094    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738097    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738099    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738102    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738104    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738108    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738111    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738113    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738116    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738118    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 09:29:53.740041 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738121    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738126    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738130    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738133    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738137    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738139    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738142    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738145    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738148    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738150    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738153    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738157    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738160    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738162    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738165    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738168    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738171    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738173    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 09:29:53.740543 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738176    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738180    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738185    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738188    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738191    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738194    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738198    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738200    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738203    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738206    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738210    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738212    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738215    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738217    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738220    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738222    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738226    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738228    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738232    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 09:29:53.740975 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738234    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738237    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738239    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738242    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738245    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738247    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738251    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738254    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738256    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738259    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738261    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738264    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738266    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738269    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738271    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738274    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738277    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738280    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738282    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738285    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 09:29:53.741442 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738287    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738290    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738726    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738737    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738740    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738743    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738746    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738748    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738751    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738754    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738757    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738761    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738764    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738766    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738769    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738771    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738774    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738777    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738780    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738783    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 09:29:53.741952 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738785    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738788    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738791    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738794    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738796    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738799    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738802    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738806    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738809    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738812    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738814    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738817    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738819    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738822    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738824    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738827    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738829    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738832    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738834    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 09:29:53.742473 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738837    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738841    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738844    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738848    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738851    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738854    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738857    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738860    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738863    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738865    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738869    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738872    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738874    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738877    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738879    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738883    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738886    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738889    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 09:29:53.742943 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738892    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738895    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738897    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738900    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738903    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738906    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738908    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738911    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738914    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738917    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738920    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738922    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738925    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738928    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738930    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738933    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738936    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738939    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738942    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738945    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 09:29:53.743416 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738947    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738950    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738953    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738955    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738958    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738961    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738963    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738966    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738968    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738971    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738973    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738975    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738978    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738980    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738983    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738985    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738988    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738990    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738993    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738995    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.738998    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 09:29:53.743905 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739000    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739003    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739005    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739074    2558 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739110    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739116    2558 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739120    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739124    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739128    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739133    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739138    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739142    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739145    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739148    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739152    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739155    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739158    2558 flags.go:64] FLAG: --cgroup-root=""
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739161    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739163    2558 flags.go:64] FLAG: --client-ca-file=""
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739166    2558 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739172    2558 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739177    2558 flags.go:64] FLAG: --cluster-domain=""
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739180    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739183    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 09:29:53.744410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739186    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739189    2558 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739193    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739196    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739199    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739202    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739205    2558 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739208    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739211    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739214    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739217    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739222    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739224    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739227    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739230    2558 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739233    2558 flags.go:64] FLAG: --enable-server="true"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739236    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739243    2558 flags.go:64] FLAG: --event-burst="100"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739246    2558 flags.go:64] FLAG: --event-qps="50"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739251    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739255    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739258    2558 flags.go:64] FLAG: --eviction-hard=""
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739261    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739265    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739268    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 09:29:53.745028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739271    2558 flags.go:64] FLAG: --eviction-soft=""
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739274    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739277    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739280    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739283    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739285    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739288    2558 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739291    2558 flags.go:64] FLAG: --feature-gates=""
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739295    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739298    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739301    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739304    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739307    2558 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739310    2558 flags.go:64] FLAG: --help="false"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739317    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-161.ec2.internal"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739320    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739323    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739326    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739329    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739333    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739336    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739338    2558 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739341    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 09:29:53.745636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739344    2558 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739348    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739351    2558 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739356    2558 flags.go:64] FLAG: --kube-reserved=""
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739359    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739362    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739366    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739368    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739371    2558 flags.go:64] FLAG: --lock-file=""
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739374    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739377    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739380    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739386    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739389    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739391    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739394    2558 flags.go:64] FLAG: --logging-format="text"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739397    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739401    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739403    2558 flags.go:64] FLAG: --manifest-url=""
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739406    2558 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739411    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739414    2558 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739418    2558 flags.go:64] FLAG: --max-pods="110"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739421    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739424    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 09:29:53.746256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739427    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739429    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739432    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739435    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739438    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739445    2558 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739463    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739466    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739471    2558 flags.go:64] FLAG: --pod-cidr=""
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739474    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739479    2558 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739483    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739487    2558 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739490    2558 flags.go:64] FLAG: --port="10250"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739493    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739496    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e3a78682dbd602cb"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739499    2558 flags.go:64] FLAG: --qos-reserved=""
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739502    2558 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739505    2558 flags.go:64] FLAG: --register-node="true"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739508    2558 flags.go:64] FLAG: --register-with-taints=""
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739511    2558 flags.go:64] FLAG: --registry-burst="10"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739514    2558 flags.go:64] FLAG: --registry-qps="5"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739517    2558 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739520    2558 flags.go:64] FLAG: --reserved-memory=""
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739524    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 09:29:53.746882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739527    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739530    2558 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739533    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739536    2558 flags.go:64] FLAG: --runonce="false"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739539    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739542    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739546    2558 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739548    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739551    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739555    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739558    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739561    2558 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739564    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739567    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739570    2558 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739574    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739577    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739580    2558 flags.go:64] FLAG: --system-cgroups=""
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739583    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739589    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739592    2558 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739595    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739600    2558 flags.go:64] FLAG: --tls-min-version=""
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739604    2558 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739607    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 09:29:53.747773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739610    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739613    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739616    2558 flags.go:64] FLAG: --v="2"
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739620    2558 flags.go:64] FLAG: --version="false"
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739624    2558 flags.go:64] FLAG: --vmodule=""
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739628    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.739631    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739746    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739749    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739752    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739755    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739757    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739760    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739763    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739765    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739768    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739770    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739773    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739775    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739778    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739780    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 09:29:53.748500 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739783    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739789    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739792    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739796    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739800    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739802    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739805    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739809    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739811    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739814    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739817    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739820    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739824    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739828    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739831    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739833    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739837    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739839    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739842    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 09:29:53.749145 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739844    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739847    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739849    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739852    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739854    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739857    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739859    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739862    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739864    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739867    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739869    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739872    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739874    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739877    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739880    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739883    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739886    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739890    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739892    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739895    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 09:29:53.749738 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739898    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739900    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739903    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739906    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739908    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739912    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739914    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739917    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739919    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739922    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739924    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739927    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739930    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739933    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739935    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739939    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739943    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739946    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739949    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 09:29:53.750230 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739952    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739954    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739957    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739960    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739963    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739966    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739968    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739972    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739975    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739977    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739981    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739984    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739986    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739989    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739991    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739995    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.739997    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740000    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740002    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740005    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 09:29:53.750722 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740007    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740010    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740013    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740015    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740017    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740020    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.740023    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.740028    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.749698    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.749714    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.750586    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.750598    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750658    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750662    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750666    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 09:29:53.751303 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750669    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750673    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750675    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750678    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750681    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750684    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750687    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750689    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750692    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750695    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750698    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750701    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750703    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750706    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750708    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750711    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750714    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750716    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750719    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750722    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 09:29:53.751701 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750724    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750727    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750730    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750735    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750738    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750740    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750743    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750746    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750749    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750752    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750754    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750757    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750761    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750765    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750769    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750772    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750775    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750778    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750782    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750784    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 09:29:53.752195 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750787    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750790    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750792    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750795    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750798    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750801    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750803    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750806    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750808    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750811    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750813    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750816    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750819    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750821    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750824    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750827    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750830    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750833    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750836    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750839    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 09:29:53.752733 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750842    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750844    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750847    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750849    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750852    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750855    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750857    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750860    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750862    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750865    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750867    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750870    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750872    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750875    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750878    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750881    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750884    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750887    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750890    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750892    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 09:29:53.753213 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750895    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750897    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750900    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750903    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750905    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750908    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750912    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750915    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750919    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750923    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750927    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750930    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750932    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750935    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750938    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 09:29:53.753809 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.750940    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.750946    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751058    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751064    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751067    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751071    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751074    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751077    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751080    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751083    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751086    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751090    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751092    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751095    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751099    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 09:29:53.754179 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751101    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751104    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751106    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751109    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751112    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751115    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751118    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751121    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751123    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751126    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751129    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751131    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751134    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751137    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751139    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751142    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751145    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751147    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751150    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751152    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 09:29:53.754564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751155    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751157    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751160    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751162    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751165    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751167    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751170    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751172    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751175    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751178    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751180    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751183    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751186    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751188    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751191    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751193    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751196    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751198    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751201    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751203    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 09:29:53.755055 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751206    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751208    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751211    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751215    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751218    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751221    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751224    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751226    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751229    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751233    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751235    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751238    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751241    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751244    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751247    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751249    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751252    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751254    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751257    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 09:29:53.755564 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751259    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751262    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751264    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751266    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751269    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751271    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751274    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751277    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751279    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751282    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751284    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751287    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751289    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751292    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751294    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751297    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751300    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751302    2558 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751305    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 09:29:53.756029 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751307    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751310    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751313    2558 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751316    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751318    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751321    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751323    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:53.751326    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.751331    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.751437    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.754937    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.755930    2558 server.go:1019] "Starting client certificate rotation"
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.756030    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 09:29:53.756493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.756062    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 09:29:53.758655 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.758642    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 09:29:53.759755 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.759738    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 09:29:53.773059 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.773041    2558 log.go:25] "Validated CRI v1 runtime API"
Sep 17 09:29:53.777614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.777594    2558 log.go:25] "Validated CRI v1 image API"
Sep 17 09:29:53.779303 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.779289    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 09:29:53.786119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.786098    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 be2717e1-d686-4a90-bc76-081bca4daba4:/dev/nvme0n1p4 d3bf7a04-73fe-4cca-9107-51006336dd73:/dev/nvme0n1p3]
Sep 17 09:29:53.786196 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.786119    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 09:29:53.788574 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.788555    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 09:29:53.791848 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.791740    2558 manager.go:216] Machine: {Timestamp:2026-09-17 09:29:53.790276517 +0000 UTC m=+0.326199401 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101228 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22e891506d27dab26ed32cdde28fbd SystemUUID:ec22e891-506d-27da-b26e-d32cdde28fbd BootID:f81573c4-a965-4f92-a89b-0f6407eec250 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d3:5a:f7:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d3:5a:f7:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:4f:ff:ff:f3:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 09:29:53.791848 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.791844    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 09:29:53.791947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.791923    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 09:29:53.795484 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.795464    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 09:29:53.795620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.795489    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 09:29:53.796258 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.796249    2558 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 09:29:53.796290 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.796261    2558 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 09:29:53.796290 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.796269    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 09:29:53.797089 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.797078    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 09:29:53.798189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.798179    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 09:29:53.802486 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.802470    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 09:29:53.802958 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.802947    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 09:29:53.803000 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.802979    2558 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 09:29:53.803000 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.802991    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 09:29:53.803056 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.803005    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 09:29:53.803056 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.803015    2558 kubelet.go:398] "Adding apiserver pod source"
Sep 17 09:29:53.803056 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.803025    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 09:29:53.803387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.803375    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 09:29:53.803426 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.803399    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 09:29:53.807129 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.807105    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 09:29:53.810072 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.810056    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 09:29:53.810162 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.810095    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 09:29:53.812136 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812123    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812140    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812146    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812153    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812167    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812175    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812190    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812195    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 09:29:53.812198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812202    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 09:29:53.812441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812208    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 09:29:53.812441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812217    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 09:29:53.812441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.812223    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 09:29:53.812959 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.812935    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 09:29:53.812959 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.812952    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 09:29:53.813130 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.813115    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 09:29:53.813130 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.813128    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 09:29:53.816907 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.816893    2558 server.go:1268] "Started kubelet"
Sep 17 09:29:53.816980 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.816960    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 09:29:53.817039 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.816989    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 09:29:53.817088 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.817062    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 09:29:53.817851 ip-10-0-135-161 systemd[1]: Started Kubernetes Kubelet.
Sep 17 09:29:53.818524 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.818508    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 09:29:53.819765 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.819753    2558 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 09:29:53.821381 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.821362    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 09:29:53.826757 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.826740    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 09:29:53.827706 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.826581    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-161.ec2.internal.18d611ba4f35c21b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-161.ec2.internal,UID:ip-10-0-135-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-161.ec2.internal,},FirstTimestamp:2026-09-17 09:29:53.816863259 +0000 UTC m=+0.352786138,LastTimestamp:2026-09-17 09:29:53.816863259 +0000 UTC m=+0.352786138,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-161.ec2.internal,}"
Sep 17 09:29:53.827706 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.827692    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 09:29:53.828416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.828395    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 09:29:53.828528 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.828513    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:53.829209 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829192    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 09:29:53.829209 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829210    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 09:29:53.829342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829192    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 09:29:53.829342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829340    2558 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 09:29:53.829441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829346    2558 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 09:29:53.829720 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829707    2558 factory.go:55] Registering systemd factory
Sep 17 09:29:53.829764 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829750    2558 factory.go:223] Registration of the systemd container factory successfully
Sep 17 09:29:53.829973 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829957    2558 factory.go:153] Registering CRI-O factory
Sep 17 09:29:53.830024 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.829976    2558 factory.go:223] Registration of the crio container factory successfully
Sep 17 09:29:53.830054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.830025    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 09:29:53.830054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.830042    2558 factory.go:103] Registering Raw factory
Sep 17 09:29:53.830125 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.830061    2558 manager.go:1196] Started watching for new ooms in manager
Sep 17 09:29:53.830483 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.830466    2558 manager.go:349] Starting recovery of all containers
Sep 17 09:29:53.831293 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.831267    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 09:29:53.831379 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.831327    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 09:29:53.836741 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.836717    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j5r4m"
Sep 17 09:29:53.842749 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.842725    2558 manager.go:354] Recovery completed
Sep 17 09:29:53.844800 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.844780    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j5r4m"
Sep 17 09:29:53.848033 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.848019    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:53.850043 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850019    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:53.850151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850061    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:53.850151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850078    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:53.850775 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850762    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 09:29:53.850851 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850803    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 09:29:53.850851 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850823    2558 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 09:29:53.850851 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.850772    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:53.851668 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.851647    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:53.851733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.851683    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:53.851733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.851696    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:53.851888 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.851801    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-161.ec2.internal.18d611ba51300874  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-161.ec2.internal,UID:ip-10-0-135-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-161.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-161.ec2.internal,},FirstTimestamp:2026-09-17 09:29:53.850042484 +0000 UTC m=+0.385965364,LastTimestamp:2026-09-17 09:29:53.850042484 +0000 UTC m=+0.385965364,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-161.ec2.internal,}"
Sep 17 09:29:53.852736 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.852723    2558 policy_none.go:49] "None policy: Start"
Sep 17 09:29:53.852809 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.852742    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 09:29:53.852809 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.852756    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 09:29:53.854783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.854665    2558 policy_none.go:47] "Start"
Sep 17 09:29:53.880164 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880147    2558 manager.go:337] "Starting Device Plugin manager"
Sep 17 09:29:53.880275 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.880201    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 09:29:53.880275 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880216    2558 server.go:87] "Starting device plugin registration server"
Sep 17 09:29:53.880505 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880490    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 09:29:53.880586 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880508    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 09:29:53.880657 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880644    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 09:29:53.881230 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880719    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 09:29:53.881230 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.880727    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 09:29:53.881334 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.881272    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 09:29:53.881334 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.881324    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:53.980874 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.980764    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:53.983293 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.983256    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 09:29:53.983293 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.983289    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:53.983471 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.983322    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:53.983471 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.983334    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:53.983471 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.983367    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-161.ec2.internal"
Sep 17 09:29:53.984717 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.984693    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 09:29:53.984811 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.984754    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 09:29:53.984811 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.984779    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 09:29:53.984916 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.984891    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 09:29:53.987210 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.987192    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 09:29:53.993200 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:53.993184    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-161.ec2.internal"
Sep 17 09:29:53.993290 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:53.993210    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-161.ec2.internal\": node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:54.028615 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:54.028593    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:54.085539 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.085504    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"]
Sep 17 09:29:54.085662 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.085597    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:54.086584 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.086571    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:54.086645 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.086631    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:54.086645 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.086643    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:54.088934 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.088921    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:54.089056 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089041    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.089102 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089070    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:54.089714 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089697    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:54.089807 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089724    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:54.089807 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089737    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:54.089807 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089744    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:54.089807 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089763    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:54.089807 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.089772    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:54.091937 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.091921    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.092038 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.091950    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 09:29:54.092680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.092666    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 09:29:54.092767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.092693    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 09:29:54.092767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.092706    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeHasSufficientPID"
Sep 17 09:29:54.115019 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:54.115000    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-161.ec2.internal\" not found" node="ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.119604 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:54.119589    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-161.ec2.internal\" not found" node="ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.129397 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:54.129371    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:54.130543 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.130527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ced87a6ed324d36a241bb26a5e24166a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"ced87a6ed324d36a241bb26a5e24166a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.130610 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.130556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced87a6ed324d36a241bb26a5e24166a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"ced87a6ed324d36a241bb26a5e24166a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.130610 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.130584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd26d2a477286a933410d5e0d7e26830-config\") pod \"kube-apiserver-proxy-ip-10-0-135-161.ec2.internal\" (UID: \"cd26d2a477286a933410d5e0d7e26830\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.230426 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:54.230393    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:54.231583 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.231521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ced87a6ed324d36a241bb26a5e24166a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"ced87a6ed324d36a241bb26a5e24166a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.231583 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.231562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced87a6ed324d36a241bb26a5e24166a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"ced87a6ed324d36a241bb26a5e24166a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.231707 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.231588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd26d2a477286a933410d5e0d7e26830-config\") pod \"kube-apiserver-proxy-ip-10-0-135-161.ec2.internal\" (UID: \"cd26d2a477286a933410d5e0d7e26830\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.231707 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.231609    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ced87a6ed324d36a241bb26a5e24166a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"ced87a6ed324d36a241bb26a5e24166a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.231707 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.231618    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cd26d2a477286a933410d5e0d7e26830-config\") pod \"kube-apiserver-proxy-ip-10-0-135-161.ec2.internal\" (UID: \"cd26d2a477286a933410d5e0d7e26830\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.231707 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:54.231611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced87a6ed324d36a241bb26a5e24166a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal\" (UID: \"ced87a6ed324d36a241bb26a5e24166a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:54.331158 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:54.331128    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:55.887111 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:55.887092    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:55.892273 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:55.892245    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:55.900968 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:55.900948    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:56.001392 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:56.001358    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:56.101864 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:56.101829    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:56.201928 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.201897    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 09:29:56.201928 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:56.201915    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:56.225243 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.225204    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 09:29:56.225386 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.225368    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 09:29:56.225438 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.225396    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 09:29:56.302815 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:56.302747    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:56.321214 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.321152    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 09:24:55 +0000 UTC" deadline="2028-06-04 20:01:17.755615428 +0000 UTC"
Sep 17 09:29:56.321214 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.321206    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15034h31m21.434412012s"
Sep 17 09:29:56.403613 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:56.403580    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-161.ec2.internal\" not found"
Sep 17 09:29:56.469086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.469061    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 09:29:56.499347 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.499316    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:56.509366 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.509343    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 09:29:56.510858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.510845    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal"
Sep 17 09:29:56.523212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.523196    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 09:29:56.558423 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.558360    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 09:29:56.623434 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:56.623391    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced87a6ed324d36a241bb26a5e24166a.slice/crio-a9b5f918e6663bb5850952c43a3ba5ef793a78cefadda82dc5ce2503a50f7025 WatchSource:0}: Error finding container a9b5f918e6663bb5850952c43a3ba5ef793a78cefadda82dc5ce2503a50f7025: Status 404 returned error can't find the container with id a9b5f918e6663bb5850952c43a3ba5ef793a78cefadda82dc5ce2503a50f7025
Sep 17 09:29:56.627596 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:56.627567    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 09:29:56.670292 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:56.670269    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd26d2a477286a933410d5e0d7e26830.slice/crio-9ce2ccdce0dcffb898812eee0d1a64765fa38afa777a6e20fb7dff1647df37af WatchSource:0}: Error finding container 9ce2ccdce0dcffb898812eee0d1a64765fa38afa777a6e20fb7dff1647df37af: Status 404 returned error can't find the container with id 9ce2ccdce0dcffb898812eee0d1a64765fa38afa777a6e20fb7dff1647df37af
Sep 17 09:29:57.273930 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.273896    2558 apiserver.go:52] "Watching apiserver"
Sep 17 09:29:57.282886 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.282860    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 09:29:57.283375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.283340    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-pskj4","kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal","openshift-cluster-node-tuning-operator/tuned-frvkt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal","openshift-multus/multus-b28mk","openshift-network-diagnostics/network-check-target-cksrw","openshift-network-operator/iptables-alerter-6f5d7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j","openshift-dns/node-resolver-c5jjl","openshift-image-registry/node-ca-b977w","openshift-multus/multus-additional-cni-plugins-wh6wb","openshift-multus/network-metrics-daemon-smn2j","openshift-ovn-kubernetes/ovnkube-node-xfx6s","kube-system/global-pull-secret-syncer-q2c7j"]
Sep 17 09:29:57.285886 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.285866    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.288054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.288033    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.288927 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.288835    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 09:29:57.288927 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.288846    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.288927 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.288846    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.288927 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.288854    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rvf5k\""
Sep 17 09:29:57.290194 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.290174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.290975 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.290955    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 09:29:57.290975 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.290969    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z52cb\""
Sep 17 09:29:57.291320 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.291301    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.292692 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.292503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 09:29:57.292787 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.292733    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 09:29:57.292787 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.292774    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.292969 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.292955    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 09:29:57.293117 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.293099    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.293213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.293196    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 09:29:57.293213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.293207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dcsl5\""
Sep 17 09:29:57.293393 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.293377    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.293452 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.293415    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.293503 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.293437    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:29:57.295221 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.295192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.297230 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.297195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:29:57.297307 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.297287    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:29:57.297860 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.297841    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 09:29:57.297947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.297912    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.297947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.297923    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pgjjd\""
Sep 17 09:29:57.298199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.298120    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.298333 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.298213    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 09:29:57.298333 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.298329    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 09:29:57.299590 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.299573    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.302288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.301968    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.302288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.302008    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4fkxp\""
Sep 17 09:29:57.302288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.302057    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.302288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.302078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.304780 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.304760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.306678 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.306658    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2rl8p\""
Sep 17 09:29:57.306678 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.306670    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.306925 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.306910    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.307104 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.307089    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 09:29:57.307703 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.307669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.307770 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.307730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-cni-netd\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.308073 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.307951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysconfig\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.308073 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308037    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-systemd-units\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.308260 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-system-cni-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.308260 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94jhn\" (UniqueName: \"kubernetes.io/projected/81cb6af9-acaa-4f87-b164-699cadd29584-kube-api-access-94jhn\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.308260 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308110    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 09:29:57.308406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.308645 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308234    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 09:29:57.308725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308236    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 09:29:57.308853 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980a297-45dd-4937-a2d0-5ffcfbe905c9-tmp\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.308957 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308862    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vb6j4\""
Sep 17 09:29:57.308957 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-tuned\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.308957 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81cb6af9-acaa-4f87-b164-699cadd29584-multus-daemon-config\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.308957 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-etc-kubernetes\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.309151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-kubernetes\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.309151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.308991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-systemd\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.309151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:29:57.309151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-ovn\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovn-node-metrics-cert\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309131    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-kubelet\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309434 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-cni-bin\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309434 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-cni-multus\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.309434 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309426    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-lib-modules\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.309586 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-host\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.309586 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2bdj\" (UniqueName: \"kubernetes.io/projected/447b39be-328f-4aa0-beac-192550796811-kube-api-access-f2bdj\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.309586 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-hostroot\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.309725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-slash\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81cb6af9-acaa-4f87-b164-699cadd29584-cni-binary-copy\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.309725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/447b39be-328f-4aa0-beac-192550796811-hosts-file\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.309725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-kubelet\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.309914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-multus-certs\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.309914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309761    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-run-netns\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-systemd\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-var-lib-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.309914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-conf-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.310102 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.309912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysctl-d\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.310102 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6064f505-1120-4de6-b9c5-8f42dde52edc-kubelet-config\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.310102 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d211350-a515-4b38-a4a3-f82de45b1476-serviceca\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.310102 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr6ps\" (UniqueName: \"kubernetes.io/projected/9d211350-a515-4b38-a4a3-f82de45b1476-kube-api-access-fr6ps\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.310322 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-socket-dir-parent\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.310322 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-node-log\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.310936 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-cnibin\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.311011 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-netns\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.311011 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.310980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-cni-bin\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.311011 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htvdc\" (UniqueName: \"kubernetes.io/projected/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-kube-api-access-htvdc\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311028    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-cni-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.311199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.311199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/447b39be-328f-4aa0-beac-192550796811-tmp-dir\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.311199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311096    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-etc-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-log-socket\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311203    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-env-overrides\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311225    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-k8s-cni-cncf-io\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-sys\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7fb5\" (UniqueName: \"kubernetes.io/projected/f980a297-45dd-4937-a2d0-5ffcfbe905c9-kube-api-access-f7fb5\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311285    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d211350-a515-4b38-a4a3-f82de45b1476-host\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovnkube-config\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-modprobe-d\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysctl-conf\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311361    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-run\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-var-lib-kubelet\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-run-ovn-kubernetes\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovnkube-script-lib\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311446    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fst9w\""
Sep 17 09:29:57.311470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6064f505-1120-4de6-b9c5-8f42dde52edc-dbus\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.312114 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.311890    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.314477 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.314432    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 09:29:57.314477 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.314458    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 09:29:57.314740 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.314722    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4d497\""
Sep 17 09:29:57.314830 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.314757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:57.314830 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.314811    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:29:57.314935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.314758    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 09:29:57.334773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.334747    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2mzc"
Sep 17 09:29:57.343411 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.343385    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g2mzc"
Sep 17 09:29:57.400789 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.400759    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 09:29:57.412174 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-socket-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.412341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412191    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-iptables-alerter-script\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.412341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d211350-a515-4b38-a4a3-f82de45b1476-serviceca\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.412341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr6ps\" (UniqueName: \"kubernetes.io/projected/9d211350-a515-4b38-a4a3-f82de45b1476-kube-api-access-fr6ps\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.412341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-socket-dir-parent\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-node-log\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-cnibin\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-socket-dir-parent\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-cnibin\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-node-log\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.412532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-netns\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-cni-bin\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htvdc\" (UniqueName: \"kubernetes.io/projected/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-kube-api-access-htvdc\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-cni-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412623    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-cni-bin\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-netns\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412703    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-cni-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.412718    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.412787    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:29:57.912754156 +0000 UTC m=+2.978965902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412800    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d211350-a515-4b38-a4a3-f82de45b1476-serviceca\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.412816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/447b39be-328f-4aa0-beac-192550796811-tmp-dir\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412844    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-etc-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412871    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-log-socket\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412919    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-env-overrides\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-k8s-cni-cncf-io\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412953    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412948    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-log-socket\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412967    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-sys\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-k8s-cni-cncf-io\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7fb5\" (UniqueName: \"kubernetes.io/projected/f980a297-45dd-4937-a2d0-5ffcfbe905c9-kube-api-access-f7fb5\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413011    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-sys\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.412919    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-etc-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413052    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d211350-a515-4b38-a4a3-f82de45b1476-host\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovnkube-config\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-modprobe-d\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.413564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/447b39be-328f-4aa0-beac-192550796811-tmp-dir\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysctl-conf\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413137    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d211350-a515-4b38-a4a3-f82de45b1476-host\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-run\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-var-lib-kubelet\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-device-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srkbd\" (UniqueName: \"kubernetes.io/projected/33a37648-5f12-46fa-8162-136a1b6322b9-kube-api-access-srkbd\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-run\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-run-ovn-kubernetes\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413275    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-modprobe-d\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-var-lib-kubelet\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysctl-conf\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovnkube-script-lib\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-run-ovn-kubernetes\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-env-overrides\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6064f505-1120-4de6-b9c5-8f42dde52edc-dbus\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.414359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6064f505-1120-4de6-b9c5-8f42dde52edc-dbus\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413559    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovnkube-config\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-host-slash\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9mrd\" (UniqueName: \"kubernetes.io/projected/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-kube-api-access-b9mrd\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-cni-netd\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysconfig\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413754    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413772    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-682wb\" (UniqueName: \"kubernetes.io/projected/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-kube-api-access-682wb\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-cni-netd\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-system-cni-dir\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-systemd-units\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysconfig\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.415335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2cc8\" (UniqueName: \"kubernetes.io/projected/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-kube-api-access-s2cc8\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-system-cni-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.413987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-systemd-units\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94jhn\" (UniqueName: \"kubernetes.io/projected/81cb6af9-acaa-4f87-b164-699cadd29584-kube-api-access-94jhn\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980a297-45dd-4937-a2d0-5ffcfbe905c9-tmp\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414077    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-tuned\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414118    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-system-cni-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovnkube-script-lib\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81cb6af9-acaa-4f87-b164-699cadd29584-multus-daemon-config\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-etc-kubernetes\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-kubernetes\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-systemd\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414291    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-ovn\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovn-node-metrics-cert\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-kubelet\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-cni-bin\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416071 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-cni-multus\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414518    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-lib-modules\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414550    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-host\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2bdj\" (UniqueName: \"kubernetes.io/projected/447b39be-328f-4aa0-beac-192550796811-kube-api-access-f2bdj\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414628    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a79e6e8e-f387-41df-896b-d6e6f3e975f4-konnectivity-ca\") pod \"konnectivity-agent-pskj4\" (UID: \"a79e6e8e-f387-41df-896b-d6e6f3e975f4\") " pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cnibin\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-hostroot\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-registration-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414700    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414728    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a79e6e8e-f387-41df-896b-d6e6f3e975f4-agent-certs\") pod \"konnectivity-agent-pskj4\" (UID: \"a79e6e8e-f387-41df-896b-d6e6f3e975f4\") " pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-slash\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81cb6af9-acaa-4f87-b164-699cadd29584-cni-binary-copy\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/447b39be-328f-4aa0-beac-192550796811-hosts-file\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414829    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-sys-fs\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-kubelet\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-multus-certs\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-run-netns\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-systemd\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.416901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-var-lib-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.414981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-conf-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415019    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysctl-d\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81cb6af9-acaa-4f87-b164-699cadd29584-multus-daemon-config\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415063    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6064f505-1120-4de6-b9c5-8f42dde52edc-kubelet-config\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415107    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-etc-kubernetes\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415179    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-kubernetes\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415207    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6064f505-1120-4de6-b9c5-8f42dde52edc-kubelet-config\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-ovn\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-systemd\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-kubelet\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-cni-bin\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415391    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-cni-multus\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-lib-modules\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-hostroot\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415605    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-run-netns\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/447b39be-328f-4aa0-beac-192550796811-hosts-file\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-host-slash\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.417793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415722    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-var-lib-openvswitch\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-var-lib-kubelet\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81cb6af9-acaa-4f87-b164-699cadd29584-cni-binary-copy\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415812    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-run-systemd\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-host\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415866    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-multus-conf-dir\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.415970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-sysctl-d\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.418767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.416083    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81cb6af9-acaa-4f87-b164-699cadd29584-host-run-multus-certs\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.419791 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.419686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f980a297-45dd-4937-a2d0-5ffcfbe905c9-etc-tuned\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.419791 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.419709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-ovn-node-metrics-cert\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.420702 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.420457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980a297-45dd-4937-a2d0-5ffcfbe905c9-tmp\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.421379 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.420906    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:29:57.421379 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.420932    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:29:57.421379 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.420945    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:29:57.421379 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.421017    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:29:57.920998596 +0000 UTC m=+2.987210344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:29:57.422891 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.422486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7fb5\" (UniqueName: \"kubernetes.io/projected/f980a297-45dd-4937-a2d0-5ffcfbe905c9-kube-api-access-f7fb5\") pod \"tuned-frvkt\" (UID: \"f980a297-45dd-4937-a2d0-5ffcfbe905c9\") " pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.422991 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.422891    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htvdc\" (UniqueName: \"kubernetes.io/projected/ef44d4bb-87b8-4dc8-b89b-33243fdc9c08-kube-api-access-htvdc\") pod \"ovnkube-node-xfx6s\" (UID: \"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08\") " pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.423297 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.423277    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr6ps\" (UniqueName: \"kubernetes.io/projected/9d211350-a515-4b38-a4a3-f82de45b1476-kube-api-access-fr6ps\") pod \"node-ca-b977w\" (UID: \"9d211350-a515-4b38-a4a3-f82de45b1476\") " pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.424617 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.424580    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94jhn\" (UniqueName: \"kubernetes.io/projected/81cb6af9-acaa-4f87-b164-699cadd29584-kube-api-access-94jhn\") pod \"multus-b28mk\" (UID: \"81cb6af9-acaa-4f87-b164-699cadd29584\") " pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.425000 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.424981    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2bdj\" (UniqueName: \"kubernetes.io/projected/447b39be-328f-4aa0-beac-192550796811-kube-api-access-f2bdj\") pod \"node-resolver-c5jjl\" (UID: \"447b39be-328f-4aa0-beac-192550796811\") " pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.462065 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.462009    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" event={"ID":"cd26d2a477286a933410d5e0d7e26830","Type":"ContainerStarted","Data":"9ce2ccdce0dcffb898812eee0d1a64765fa38afa777a6e20fb7dff1647df37af"}
Sep 17 09:29:57.463647 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.463616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" event={"ID":"ced87a6ed324d36a241bb26a5e24166a","Type":"ContainerStarted","Data":"a9b5f918e6663bb5850952c43a3ba5ef793a78cefadda82dc5ce2503a50f7025"}
Sep 17 09:29:57.516081 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.516273 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516091    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a79e6e8e-f387-41df-896b-d6e6f3e975f4-konnectivity-ca\") pod \"konnectivity-agent-pskj4\" (UID: \"a79e6e8e-f387-41df-896b-d6e6f3e975f4\") " pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.516273 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cnibin\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.516273 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-registration-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a79e6e8e-f387-41df-896b-d6e6f3e975f4-agent-certs\") pod \"konnectivity-agent-pskj4\" (UID: \"a79e6e8e-f387-41df-896b-d6e6f3e975f4\") " pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.516441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516313    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-sys-fs\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cnibin\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.516441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-socket-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516368    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-iptables-alerter-script\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.516441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516508    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-device-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516509    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-registration-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516532    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srkbd\" (UniqueName: \"kubernetes.io/projected/33a37648-5f12-46fa-8162-136a1b6322b9-kube-api-access-srkbd\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-host-slash\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516600    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-socket-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9mrd\" (UniqueName: \"kubernetes.io/projected/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-kube-api-access-b9mrd\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-sys-fs\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.516716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-682wb\" (UniqueName: \"kubernetes.io/projected/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-kube-api-access-682wb\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516772    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cni-binary-copy\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a79e6e8e-f387-41df-896b-d6e6f3e975f4-konnectivity-ca\") pod \"konnectivity-agent-pskj4\" (UID: \"a79e6e8e-f387-41df-896b-d6e6f3e975f4\") " pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33a37648-5f12-46fa-8162-136a1b6322b9-device-dir\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516943    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-host-slash\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.516963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.517016    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-system-cni-dir\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.517066    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:29:58.017049571 +0000 UTC m=+3.083261337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517126    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2cc8\" (UniqueName: \"kubernetes.io/projected/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-kube-api-access-s2cc8\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-system-cni-dir\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.517288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-iptables-alerter-script\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.517975 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.517533    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.519297 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.519275    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a79e6e8e-f387-41df-896b-d6e6f3e975f4-agent-certs\") pod \"konnectivity-agent-pskj4\" (UID: \"a79e6e8e-f387-41df-896b-d6e6f3e975f4\") " pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.532875 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.532802    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srkbd\" (UniqueName: \"kubernetes.io/projected/33a37648-5f12-46fa-8162-136a1b6322b9-kube-api-access-srkbd\") pod \"aws-ebs-csi-driver-node-4sf4j\" (UID: \"33a37648-5f12-46fa-8162-136a1b6322b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.532994 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.532944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-682wb\" (UniqueName: \"kubernetes.io/projected/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-kube-api-access-682wb\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:57.533224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.533201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2cc8\" (UniqueName: \"kubernetes.io/projected/6d4ec09b-e1ce-4461-bdfd-39f55cff06f4-kube-api-access-s2cc8\") pod \"multus-additional-cni-plugins-wh6wb\" (UID: \"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4\") " pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.533815 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.533792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9mrd\" (UniqueName: \"kubernetes.io/projected/c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d-kube-api-access-b9mrd\") pod \"iptables-alerter-6f5d7\" (UID: \"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d\") " pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.599337 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.599298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b977w"
Sep 17 09:29:57.607642 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.607438    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frvkt"
Sep 17 09:29:57.613744 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.613698    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d211350_a515_4b38_a4a3_f82de45b1476.slice/crio-8138695c091d43bb91179cc44ce73c4bdd77786d805a13522765466f6c1fb780 WatchSource:0}: Error finding container 8138695c091d43bb91179cc44ce73c4bdd77786d805a13522765466f6c1fb780: Status 404 returned error can't find the container with id 8138695c091d43bb91179cc44ce73c4bdd77786d805a13522765466f6c1fb780
Sep 17 09:29:57.616742 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.616720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:29:57.622726 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.622691    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b28mk"
Sep 17 09:29:57.627424 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.627401    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef44d4bb_87b8_4dc8_b89b_33243fdc9c08.slice/crio-b14c7b68abbe4ec18e6246b5094f840cb6744106cb59e9f278126821ef28cddf WatchSource:0}: Error finding container b14c7b68abbe4ec18e6246b5094f840cb6744106cb59e9f278126821ef28cddf: Status 404 returned error can't find the container with id b14c7b68abbe4ec18e6246b5094f840cb6744106cb59e9f278126821ef28cddf
Sep 17 09:29:57.630054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.630030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c5jjl"
Sep 17 09:29:57.632407 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.632373    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81cb6af9_acaa_4f87_b164_699cadd29584.slice/crio-bdd2db53135936a98b5e72274f1d8c85912c908724b1f79f103205fcab61a5cf WatchSource:0}: Error finding container bdd2db53135936a98b5e72274f1d8c85912c908724b1f79f103205fcab61a5cf: Status 404 returned error can't find the container with id bdd2db53135936a98b5e72274f1d8c85912c908724b1f79f103205fcab61a5cf
Sep 17 09:29:57.639400 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.639239    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6f5d7"
Sep 17 09:29:57.639827 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.639792    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447b39be_328f_4aa0_beac_192550796811.slice/crio-3028862cff4d2c5cd5c677cf12495a331ee945e2e6d15a2cd2e531280fb2eb17 WatchSource:0}: Error finding container 3028862cff4d2c5cd5c677cf12495a331ee945e2e6d15a2cd2e531280fb2eb17: Status 404 returned error can't find the container with id 3028862cff4d2c5cd5c677cf12495a331ee945e2e6d15a2cd2e531280fb2eb17
Sep 17 09:29:57.647034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.647020    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j"
Sep 17 09:29:57.649931 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.649901    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18a7c6c_b3d6_4b61_ac1e_b9e1d55ec63d.slice/crio-af363f174b389bbf5809fbf4f0517f7fe4cd188ad789afa06e84d7f60bc46d3d WatchSource:0}: Error finding container af363f174b389bbf5809fbf4f0517f7fe4cd188ad789afa06e84d7f60bc46d3d: Status 404 returned error can't find the container with id af363f174b389bbf5809fbf4f0517f7fe4cd188ad789afa06e84d7f60bc46d3d
Sep 17 09:29:57.653973 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.653949    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:29:57.658042 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.658016    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a37648_5f12_46fa_8162_136a1b6322b9.slice/crio-6aa5ed892a6000394c8b0ebb6e9a5fd63d782ed37100aebd1d568b2d93a68271 WatchSource:0}: Error finding container 6aa5ed892a6000394c8b0ebb6e9a5fd63d782ed37100aebd1d568b2d93a68271: Status 404 returned error can't find the container with id 6aa5ed892a6000394c8b0ebb6e9a5fd63d782ed37100aebd1d568b2d93a68271
Sep 17 09:29:57.660281 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.660265    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wh6wb"
Sep 17 09:29:57.663513 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.663488    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79e6e8e_f387_41df_896b_d6e6f3e975f4.slice/crio-0abd518b90ceac896c798cc7ef2620f05a87cf81dd5befe6b0c7621838049e15 WatchSource:0}: Error finding container 0abd518b90ceac896c798cc7ef2620f05a87cf81dd5befe6b0c7621838049e15: Status 404 returned error can't find the container with id 0abd518b90ceac896c798cc7ef2620f05a87cf81dd5befe6b0c7621838049e15
Sep 17 09:29:57.670354 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:29:57.670332    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4ec09b_e1ce_4461_bdfd_39f55cff06f4.slice/crio-4526bc81111fdcf78a191a1fc24aec937784abc798374ccad72543aec47b9c91 WatchSource:0}: Error finding container 4526bc81111fdcf78a191a1fc24aec937784abc798374ccad72543aec47b9c91: Status 404 returned error can't find the container with id 4526bc81111fdcf78a191a1fc24aec937784abc798374ccad72543aec47b9c91
Sep 17 09:29:57.919681 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:57.919588    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:57.919857 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.919736    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:29:57.919857 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:57.919807    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:29:58.9197819 +0000 UTC m=+3.985993650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:29:58.020098 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.020066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:58.020304 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.020118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:29:58.020304 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.020249    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:29:58.020304 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.020274    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:29:58.020304 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.020292    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:29:58.020304 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.020304    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:29:58.020545 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.020336    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:29:59.020312765 +0000 UTC m=+4.086524511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:29:58.020545 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.020358    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:29:59.020347041 +0000 UTC m=+4.086558789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:29:58.160052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.160020    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 09:29:58.347069 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.346975    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 09:24:57 +0000 UTC" deadline="2028-06-30 01:06:23.214377188 +0000 UTC"
Sep 17 09:29:58.347069 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.347031    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15639h36m24.86735216s"
Sep 17 09:29:58.454917 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.454879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:29:58.455103 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.454997    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:29:58.466485 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.466448    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j" event={"ID":"33a37648-5f12-46fa-8162-136a1b6322b9","Type":"ContainerStarted","Data":"6aa5ed892a6000394c8b0ebb6e9a5fd63d782ed37100aebd1d568b2d93a68271"}
Sep 17 09:29:58.467658 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.467622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6f5d7" event={"ID":"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d","Type":"ContainerStarted","Data":"af363f174b389bbf5809fbf4f0517f7fe4cd188ad789afa06e84d7f60bc46d3d"}
Sep 17 09:29:58.468631 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.468608    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5jjl" event={"ID":"447b39be-328f-4aa0-beac-192550796811","Type":"ContainerStarted","Data":"3028862cff4d2c5cd5c677cf12495a331ee945e2e6d15a2cd2e531280fb2eb17"}
Sep 17 09:29:58.469750 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.469727    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"b14c7b68abbe4ec18e6246b5094f840cb6744106cb59e9f278126821ef28cddf"}
Sep 17 09:29:58.470791 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.470765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frvkt" event={"ID":"f980a297-45dd-4937-a2d0-5ffcfbe905c9","Type":"ContainerStarted","Data":"6e01738ef9de33425f8a62f052ff6520aeb0e4cd2779013d04c1f54b3566210a"}
Sep 17 09:29:58.471826 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.471801    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b28mk" event={"ID":"81cb6af9-acaa-4f87-b164-699cadd29584","Type":"ContainerStarted","Data":"bdd2db53135936a98b5e72274f1d8c85912c908724b1f79f103205fcab61a5cf"}
Sep 17 09:29:58.472918 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.472895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b977w" event={"ID":"9d211350-a515-4b38-a4a3-f82de45b1476","Type":"ContainerStarted","Data":"8138695c091d43bb91179cc44ce73c4bdd77786d805a13522765466f6c1fb780"}
Sep 17 09:29:58.473932 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.473910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerStarted","Data":"4526bc81111fdcf78a191a1fc24aec937784abc798374ccad72543aec47b9c91"}
Sep 17 09:29:58.475038 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.475014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pskj4" event={"ID":"a79e6e8e-f387-41df-896b-d6e6f3e975f4","Type":"ContainerStarted","Data":"0abd518b90ceac896c798cc7ef2620f05a87cf81dd5befe6b0c7621838049e15"}
Sep 17 09:29:58.927152 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:58.926913    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:58.927323 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.927082    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:29:58.927323 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:58.927243    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:30:00.927225899 +0000 UTC m=+5.993437655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:29:59.029286 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.028939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:59.029286 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.028998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:29:59.029286 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.029137    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:29:59.029286 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.029155    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:29:59.029286 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.029260    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:29:59.029286 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.029287    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:29:59.029705 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.029322    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:01.029303845 +0000 UTC m=+6.095515606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:29:59.029705 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.029397    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:01.029384541 +0000 UTC m=+6.095596291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:29:59.347276 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.347180    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 09:24:57 +0000 UTC" deadline="2028-02-17 01:59:37.31313317 +0000 UTC"
Sep 17 09:29:59.347276 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.347236    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12424h29m37.965901188s"
Sep 17 09:29:59.458077 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.458039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:29:59.458257 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.458205    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:29:59.458334 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.458298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:29:59.458431 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:29:59.458384    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:29:59.487442 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.487406    2558 generic.go:356] "Generic (PLEG): container finished" podID="ced87a6ed324d36a241bb26a5e24166a" containerID="ea24bd92bbdd66772b2924f4c385cb874342209fecb96974cde0374549ff28af" exitCode=0
Sep 17 09:29:59.487618 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.487511    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" event={"ID":"ced87a6ed324d36a241bb26a5e24166a","Type":"ContainerDied","Data":"ea24bd92bbdd66772b2924f4c385cb874342209fecb96974cde0374549ff28af"}
Sep 17 09:29:59.497008 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:29:59.496975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" event={"ID":"cd26d2a477286a933410d5e0d7e26830","Type":"ContainerStarted","Data":"5413f7b37d4cd6c1e31fa8a7b5a2d6e9026d37fef9316407cf3f51a70e8392ae"}
Sep 17 09:30:00.455174 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:00.455101    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:00.455764 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:00.455254    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:00.947739 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:00.947132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:00.947739 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:00.947323    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:00.947739 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:00.947381    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:30:04.947362574 +0000 UTC m=+10.013574323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:01.047928 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:01.047884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:01.048095 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:01.047946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:01.048095 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.048044    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:01.048095 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.048066    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:30:01.048095 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.048080    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:30:01.048095 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.048092    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:01.048387 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.048103    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:05.048084553 +0000 UTC m=+10.114296307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:01.048387 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.048126    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:05.048115353 +0000 UTC m=+10.114327101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:01.456094 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:01.455851    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:01.456094 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.456000    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:01.456094 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:01.456029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:01.456692 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:01.456129    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:02.455290 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:02.455253    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:02.455466 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:02.455400    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:03.455009 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:03.454971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:03.455423 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:03.455016    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:03.455423 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:03.455118    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:03.455597 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:03.455564    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:04.454878 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:04.454783    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:04.455051 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:04.454911    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:04.980383 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:04.980344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:04.980585 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:04.980515    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:04.980652 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:04.980604    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:30:12.980583447 +0000 UTC m=+18.046795196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:05.081449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:05.081408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:05.081624 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:05.081469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:05.081709 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.081616    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:05.081709 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.081629    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:30:05.081709 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.081655    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:30:05.081709 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.081668    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:05.081894 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.081721    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:13.081672155 +0000 UTC m=+18.147883913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:05.081894 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.081745    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:13.081733189 +0000 UTC m=+18.147944936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:05.456784 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:05.456552    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:05.456784 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:05.456594    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:05.456784 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.456681    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:05.456784 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:05.456772    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:06.455557 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:06.455522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:06.455746 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:06.455650    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:07.455733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:07.455415    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:07.455733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:07.455464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:07.455733 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:07.455551    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:07.455733 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:07.455683    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:08.455124 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:08.455086    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:08.455299 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:08.455231    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:09.458052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:09.458020    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:09.458541 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:09.458065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:09.458541 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:09.458143    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:09.458541 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:09.458252    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:10.454894 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:10.454858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:10.455076 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:10.455000    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:11.454927 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:11.454887    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:11.455492 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:11.455039    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:11.455492 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:11.455069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:11.455492 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:11.455189    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:12.455216 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:12.455186    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:12.455657 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:12.455291    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:13.038749 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:13.038704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:13.038927 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.038830    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:13.038927 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.038900    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:30:29.038881215 +0000 UTC m=+34.105092959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:13.139971 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:13.139936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:13.140195 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:13.140110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:13.140195 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.140128    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:30:13.140308 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.140201    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:13.140308 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.140206    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:30:13.140308 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.140225    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:13.140308 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.140262    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:29.140242778 +0000 UTC m=+34.206454520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:13.140308 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.140279    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:29.140272715 +0000 UTC m=+34.206484458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:13.455510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:13.455427    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:13.455510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:13.455473    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:13.456018 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.455591    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:13.456018 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:13.455704    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:14.454921 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:14.454889    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:14.455101 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:14.455014    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:15.458012 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:15.457986    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:15.458432 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:15.458123    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:15.458525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:15.458503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:15.458641 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:15.458623    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:15.541541 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:15.541457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pskj4" event={"ID":"a79e6e8e-f387-41df-896b-d6e6f3e975f4","Type":"ContainerStarted","Data":"8f990ed771d4a07bda1dc628fb37fcb054cc27b89a56ea475cf967713276b826"}
Sep 17 09:30:16.455672 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.455497    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:16.455830 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:16.455755    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:16.547374 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.547336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c5jjl" event={"ID":"447b39be-328f-4aa0-beac-192550796811","Type":"ContainerStarted","Data":"3de2ac4d9cd0b248a1251833acddaf9a4f5cb9e87647d0633f9f5d1740ce51b7"}
Sep 17 09:30:16.550482 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.550459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"bf6e98f1b1edd157b2a708b9ec36749609c11cc89628344ccfccf3677e5a3aea"}
Sep 17 09:30:16.550584 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.550531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"a5df90164101b8f9e526c6e1e44b49078bb18af8f8e44ee128034d216fb832fb"}
Sep 17 09:30:16.550637 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.550582    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"342f32f3a4f58e8ecf37fbc4912d89317cf54cab30ed55738e99ac01f01c1d16"}
Sep 17 09:30:16.550637 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.550630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"bd819e1f17bac91bc63f4c54b7ec136f69256279e9a87dc6e2de8b76ec085dc3"}
Sep 17 09:30:16.550710 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.550693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"0d0cbf867554f8b81838028fb21483b76e4310b7897bb97dd400eb97e411112c"}
Sep 17 09:30:16.550759 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.550726    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"05133ae1dea6604a141adcb69fb7de381f0b46ea95032aeaaefc15f52c324cea"}
Sep 17 09:30:16.551990 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.551966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frvkt" event={"ID":"f980a297-45dd-4937-a2d0-5ffcfbe905c9","Type":"ContainerStarted","Data":"9804ffbed9855af817212e045577f8d75627034bc566bfb0a1f7672f0bf67e84"}
Sep 17 09:30:16.553830 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.553811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" event={"ID":"ced87a6ed324d36a241bb26a5e24166a","Type":"ContainerStarted","Data":"08d3c3014a193f4e52943cc0814aba5ef3b989ecd18aa5127b7d05903e28233e"}
Sep 17 09:30:16.555201 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.555181    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b28mk" event={"ID":"81cb6af9-acaa-4f87-b164-699cadd29584","Type":"ContainerStarted","Data":"54eece6554f6e9d3f17546a5f232796023135ef132a992905cfafaa19ae87423"}
Sep 17 09:30:16.556553 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.556535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b977w" event={"ID":"9d211350-a515-4b38-a4a3-f82de45b1476","Type":"ContainerStarted","Data":"e7574723b7fb18527aec087ef255e179e41e0096508ecb1ff863ea20ec24b765"}
Sep 17 09:30:16.557989 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.557967    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d4ec09b-e1ce-4461-bdfd-39f55cff06f4" containerID="72a12ddbc74eb78807d31ef5155ad9719e87b8d2b0fb7abf1742df029845060e" exitCode=0
Sep 17 09:30:16.558060 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.558037    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerDied","Data":"72a12ddbc74eb78807d31ef5155ad9719e87b8d2b0fb7abf1742df029845060e"}
Sep 17 09:30:16.559543 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.559525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j" event={"ID":"33a37648-5f12-46fa-8162-136a1b6322b9","Type":"ContainerStarted","Data":"8e84a89640d37b21ebaaafe6c0ecb7195d3df72870f1c0de32e9f9ce341f50ef"}
Sep 17 09:30:16.565348 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.565307    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-161.ec2.internal" podStartSLOduration=20.565296375 podStartE2EDuration="20.565296375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:29:59.52932375 +0000 UTC m=+4.595535516" watchObservedRunningTime="2026-09-17 09:30:16.565296375 +0000 UTC m=+21.631508153"
Sep 17 09:30:16.565651 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.565626    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-c5jjl" podStartSLOduration=3.831790047 podStartE2EDuration="21.565620648s" totalImagesPullingTime="17.733830601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:16.565124798 +0000 UTC m=+21.631336563" watchObservedRunningTime="2026-09-17 09:30:16.565620648 +0000 UTC m=+21.631832413"
Sep 17 09:30:16.588042 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.588004    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-frvkt" podStartSLOduration=3.814874961 podStartE2EDuration="21.587991798s" totalImagesPullingTime="17.773116837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:16.587550993 +0000 UTC m=+21.653762757" watchObservedRunningTime="2026-09-17 09:30:16.587991798 +0000 UTC m=+21.654203563"
Sep 17 09:30:16.608196 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.608149    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b28mk" podStartSLOduration=3.79519307 podStartE2EDuration="21.608136151s" totalImagesPullingTime="17.812943081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:16.608041079 +0000 UTC m=+21.674252844" watchObservedRunningTime="2026-09-17 09:30:16.608136151 +0000 UTC m=+21.674347916"
Sep 17 09:30:16.629523 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.629484    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pskj4" podStartSLOduration=7.838688741 podStartE2EDuration="21.629471472s" totalImagesPullingTime="13.790782731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:16.629092824 +0000 UTC m=+21.695304588" watchObservedRunningTime="2026-09-17 09:30:16.629471472 +0000 UTC m=+21.695683236"
Sep 17 09:30:16.676771 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.676684    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-161.ec2.internal" podStartSLOduration=20.676670196 podStartE2EDuration="20.676670196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:16.676642548 +0000 UTC m=+21.742854312" watchObservedRunningTime="2026-09-17 09:30:16.676670196 +0000 UTC m=+21.742881961"
Sep 17 09:30:16.700965 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:16.699808    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b977w" podStartSLOduration=7.858463746 podStartE2EDuration="21.699788627s" totalImagesPullingTime="13.841324881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:16.698581327 +0000 UTC m=+21.764793091" watchObservedRunningTime="2026-09-17 09:30:16.699788627 +0000 UTC m=+21.766000389"
Sep 17 09:30:17.455633 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:17.455594    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:17.455927 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:17.455729    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:17.456096 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:17.455594    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:17.456217 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:17.456198    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:17.563833 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:17.563761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6f5d7" event={"ID":"c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d","Type":"ContainerStarted","Data":"91bcc9a431507b174fedfff7834140794e402ca127fe546f8522f3f031a61661"}
Sep 17 09:30:17.581361 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:17.581313    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6f5d7" podStartSLOduration=4.876304163 podStartE2EDuration="22.581296655s" totalImagesPullingTime="17.704992492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:17.580867931 +0000 UTC m=+22.647079697" watchObservedRunningTime="2026-09-17 09:30:17.581296655 +0000 UTC m=+22.647508459"
Sep 17 09:30:18.030403 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.030383    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 09:30:18.228822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.228798    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:30:18.229699 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.229678    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:30:18.363223 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.363116    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T09:30:18.030400323Z","UUID":"5f40d9e1-d16d-4fc3-8938-a4a347142eee","Handler":null,"Name":"","Endpoint":""}
Sep 17 09:30:18.364588 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.364567    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 09:30:18.364588 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.364603    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 09:30:18.454940 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.454860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:18.455098 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:18.454984    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:18.567984 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.567950    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j" event={"ID":"33a37648-5f12-46fa-8162-136a1b6322b9","Type":"ContainerStarted","Data":"4c5b656c6242e75a6aa6202cf25cacaeda7a7800c8ead17d4e14bf7755351a64"}
Sep 17 09:30:18.571334 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:18.571301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"3fbb23ecfe74efc9896b97fca7179be69c32f1c1a63783679dbac7d45f51f4d7"}
Sep 17 09:30:19.455114 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:19.455078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:19.455411 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:19.455078    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:19.455411 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:19.455229    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:19.455411 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:19.455285    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:19.575116 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:19.575084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j" event={"ID":"33a37648-5f12-46fa-8162-136a1b6322b9","Type":"ContainerStarted","Data":"23ef9bcee34bdeddf7db1e822f28074f47817fc08cdd4ac2c18aee436196959f"}
Sep 17 09:30:19.615340 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:19.615282    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sf4j" podStartSLOduration=3.213224844 podStartE2EDuration="24.615262558s" totalImagesPullingTime="21.402037714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:19.614934835 +0000 UTC m=+24.681146719" watchObservedRunningTime="2026-09-17 09:30:19.615262558 +0000 UTC m=+24.681474324"
Sep 17 09:30:20.454661 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:20.454626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:20.454829 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:20.454734    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:21.454805 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:21.454782    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:21.455190 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:21.454888    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:21.455190 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:21.454941    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:21.455190 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:21.455007    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:21.583598 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:21.583563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" event={"ID":"ef44d4bb-87b8-4dc8-b89b-33243fdc9c08","Type":"ContainerStarted","Data":"76757a2cfe3823fde892e9e2937766842f7835c53d4a64f16f9fe99045c5ea5a"}
Sep 17 09:30:21.583873 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:21.583844    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:30:21.598311 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:21.598278    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:30:21.613632 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:21.613590    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s" podStartSLOduration=8.397440174 podStartE2EDuration="26.613573713s" totalImagesPullingTime="18.216133539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:21.613042043 +0000 UTC m=+26.679253807" watchObservedRunningTime="2026-09-17 09:30:21.613573713 +0000 UTC m=+26.679785477"
Sep 17 09:30:22.389937 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.389899    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:30:22.390204 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.390070    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 09:30:22.390508 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.390489    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pskj4"
Sep 17 09:30:22.455369 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.455345    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:22.455724 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:22.455430    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:22.587182 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.587132    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d4ec09b-e1ce-4461-bdfd-39f55cff06f4" containerID="dc8c5628bfc919ac7c537f7793d79b8ea17a3833eeff17ceb0999a811296e95b" exitCode=0
Sep 17 09:30:22.587368 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.587220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerDied","Data":"dc8c5628bfc919ac7c537f7793d79b8ea17a3833eeff17ceb0999a811296e95b"}
Sep 17 09:30:22.587573 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.587553    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 09:30:22.588534 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.587964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:30:22.602937 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:22.602917    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:30:23.324733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.324696    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:30:23.387567 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.387536    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cksrw"]
Sep 17 09:30:23.387753 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.387640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:23.387753 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:23.387728    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:23.389852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.389827    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2c7j"]
Sep 17 09:30:23.389962 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.389913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:23.390021 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:23.389979    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:23.392990 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.392970    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-smn2j"]
Sep 17 09:30:23.393084 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:23.393060    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:23.393179 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:23.393143    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:24.593869 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:24.593782    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d4ec09b-e1ce-4461-bdfd-39f55cff06f4" containerID="ec4401eb535e60971525c1fb41a122487b967c848d013b2fd0facfd7c7939002" exitCode=0
Sep 17 09:30:24.593869 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:24.593853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerDied","Data":"ec4401eb535e60971525c1fb41a122487b967c848d013b2fd0facfd7c7939002"}
Sep 17 09:30:25.455974 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:25.455788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:25.456135 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:25.455848    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:25.456135 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:25.456044    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:25.456135 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:25.455874    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:25.456135 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:25.456120    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:25.456305 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:25.456219    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:25.598594 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:25.598485    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d4ec09b-e1ce-4461-bdfd-39f55cff06f4" containerID="55754c9346b1ce3b201b7124cd9d8e838e0ee1670609fa0ed11b493f653cbc80" exitCode=0
Sep 17 09:30:25.598594 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:25.598539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerDied","Data":"55754c9346b1ce3b201b7124cd9d8e838e0ee1670609fa0ed11b493f653cbc80"}
Sep 17 09:30:27.455224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:27.455174    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:27.455224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:27.455226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:27.455860 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:27.455170    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:27.455860 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:27.455320    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-smn2j" podUID="87d3569c-fa7b-4bad-bc42-d7b1869b4c39"
Sep 17 09:30:27.455860 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:27.455387    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q2c7j" podUID="6064f505-1120-4de6-b9c5-8f42dde52edc"
Sep 17 09:30:27.455860 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:27.455469    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cksrw" podUID="ee7916f6-be31-4a69-a45d-9782fd83af26"
Sep 17 09:30:28.205687 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.205657    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-161.ec2.internal" event="NodeReady"
Sep 17 09:30:28.206057 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.205799    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 09:30:28.249220 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.249117    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69dd7d55cd-bd965"]
Sep 17 09:30:28.266054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.266024    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69dd7d55cd-bd965"]
Sep 17 09:30:28.266252 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.266178    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.268867 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.268483    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zjm4h"]
Sep 17 09:30:28.269636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.269467    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 09:30:28.269636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.269517    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q8zp\""
Sep 17 09:30:28.269636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.269561    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 09:30:28.269636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.269577    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 09:30:28.276007 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.275982    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 09:30:28.290034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.290012    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p2qq6"]
Sep 17 09:30:28.290152 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.290137    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.293228 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.293209    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 09:30:28.293519 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.293496    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 09:30:28.293519 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.293496    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lx2nq\""
Sep 17 09:30:28.312081 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.312055    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p2qq6"]
Sep 17 09:30:28.312081 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.312085    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zjm4h"]
Sep 17 09:30:28.312248 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.312184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.315053 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.315034    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 09:30:28.315147 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.315055    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cngv6\""
Sep 17 09:30:28.315292 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.315277    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 09:30:28.315398 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.315380    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 09:30:28.351504 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-certificates\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.351677 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-bound-sa-token\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.351677 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351600    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-image-registry-private-configuration\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-trusted-ca\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52nmg\" (UniqueName: \"kubernetes.io/projected/79985231-f3e8-452d-ba6f-b9e91e723e20-kube-api-access-52nmg\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-ca-trust-extracted\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-installation-pull-secrets\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxwbh\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-kube-api-access-lxwbh\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.352052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.351951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79985231-f3e8-452d-ba6f-b9e91e723e20-tmp-dir\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.352336 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.352048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.352336 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.352088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79985231-f3e8-452d-ba6f-b9e91e723e20-config-volume\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.453123 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.453341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-image-registry-private-configuration\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453220    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-trusted-ca\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52nmg\" (UniqueName: \"kubernetes.io/projected/79985231-f3e8-452d-ba6f-b9e91e723e20-kube-api-access-52nmg\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.453341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-ca-trust-extracted\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453561 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453349    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-installation-pull-secrets\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453561 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.453380    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:30:28.453561 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.453453    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:28.953432003 +0000 UTC m=+34.019643750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:30:28.453561 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxwbh\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-kube-api-access-lxwbh\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453561 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79985231-f3e8-452d-ba6f-b9e91e723e20-tmp-dir\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.453822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79985231-f3e8-452d-ba6f-b9e91e723e20-config-volume\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.453822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6mqn\" (UniqueName: \"kubernetes.io/projected/8acd66fa-2c9b-4f60-a733-886354a893cd-kube-api-access-m6mqn\") pod \"ingress-canary-p2qq6\" (UID: \"8acd66fa-2c9b-4f60-a733-886354a893cd\") " pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.453822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-certificates\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.453822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8acd66fa-2c9b-4f60-a733-886354a893cd-cert\") pod \"ingress-canary-p2qq6\" (UID: \"8acd66fa-2c9b-4f60-a733-886354a893cd\") " pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.453822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453768    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-ca-trust-extracted\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.454099 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.453852    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:30:28.454099 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.453866    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:30:28.454099 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.453914    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:28.953897368 +0000 UTC m=+34.020109118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:30:28.454099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79985231-f3e8-452d-ba6f-b9e91e723e20-tmp-dir\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.454099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.453963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-bound-sa-token\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.454317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.454268    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-trusted-ca\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.454420 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.454399    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79985231-f3e8-452d-ba6f-b9e91e723e20-config-volume\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.454565 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.454505    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-certificates\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.457633 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.457607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-installation-pull-secrets\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.457633 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.457616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-image-registry-private-configuration\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.465569 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.465545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52nmg\" (UniqueName: \"kubernetes.io/projected/79985231-f3e8-452d-ba6f-b9e91e723e20-kube-api-access-52nmg\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.465806 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.465658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxwbh\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-kube-api-access-lxwbh\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.466028 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.466010    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-bound-sa-token\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.554441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.554360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6mqn\" (UniqueName: \"kubernetes.io/projected/8acd66fa-2c9b-4f60-a733-886354a893cd-kube-api-access-m6mqn\") pod \"ingress-canary-p2qq6\" (UID: \"8acd66fa-2c9b-4f60-a733-886354a893cd\") " pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.554441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.554408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8acd66fa-2c9b-4f60-a733-886354a893cd-cert\") pod \"ingress-canary-p2qq6\" (UID: \"8acd66fa-2c9b-4f60-a733-886354a893cd\") " pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.557243 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.557217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8acd66fa-2c9b-4f60-a733-886354a893cd-cert\") pod \"ingress-canary-p2qq6\" (UID: \"8acd66fa-2c9b-4f60-a733-886354a893cd\") " pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.565828 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.565793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6mqn\" (UniqueName: \"kubernetes.io/projected/8acd66fa-2c9b-4f60-a733-886354a893cd-kube-api-access-m6mqn\") pod \"ingress-canary-p2qq6\" (UID: \"8acd66fa-2c9b-4f60-a733-886354a893cd\") " pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.622890 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.622858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p2qq6"
Sep 17 09:30:28.949020 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.948922    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p2qq6"]
Sep 17 09:30:28.954605 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:30:28.954576    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8acd66fa_2c9b_4f60_a733_886354a893cd.slice/crio-7a8349e514cb08eeef270cfeb31777cd586be218755b1d0ce817689bef593311 WatchSource:0}: Error finding container 7a8349e514cb08eeef270cfeb31777cd586be218755b1d0ce817689bef593311: Status 404 returned error can't find the container with id 7a8349e514cb08eeef270cfeb31777cd586be218755b1d0ce817689bef593311
Sep 17 09:30:28.957145 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.957120    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:28.957361 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:28.957337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:28.957553 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.957469    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:30:28.957553 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.957493    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:30:28.957553 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.957503    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:30:28.957705 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.957561    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:29.95754236 +0000 UTC m=+35.023754141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:30:28.957705 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:28.957580    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:29.95757131 +0000 UTC m=+35.023783056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:30:29.058688 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.058651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:29.058860 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.058827    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:29.058925 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.058916    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret podName:6064f505-1120-4de6-b9c5-8f42dde52edc nodeName:}" failed. No retries permitted until 2026-09-17 09:31:01.058895895 +0000 UTC m=+66.125107641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret") pod "global-pull-secret-syncer-q2c7j" (UID: "6064f505-1120-4de6-b9c5-8f42dde52edc") : object "kube-system"/"original-pull-secret" not registered
Sep 17 09:30:29.159910 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.159878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:29.160042 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.159922    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:29.160089 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.160062    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:29.160128 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.160117    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 09:30:29.160181 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.160129    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 09:30:29.160181 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.160138    2558 projected.go:196] Error preparing data for projected volume kube-api-access-cslbh for pod openshift-network-diagnostics/network-check-target-cksrw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:29.160181 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.160143    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:01.160122212 +0000 UTC m=+66.226333962 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 09:30:29.160291 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.160191    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh podName:ee7916f6-be31-4a69-a45d-9782fd83af26 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:01.160177642 +0000 UTC m=+66.226389386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cslbh" (UniqueName: "kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh") pod "network-check-target-cksrw" (UID: "ee7916f6-be31-4a69-a45d-9782fd83af26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 09:30:29.454958 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.454928    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:30:29.455150 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.454928    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:30:29.455150 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.455071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:30:29.459463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.459172    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 09:30:29.459463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.459208    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 09:30:29.459463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.459219    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mpw9\""
Sep 17 09:30:29.459463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.459256    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 09:30:29.459463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.459214    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 09:30:29.459945 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.459503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5k2bt\""
Sep 17 09:30:29.610515 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.610478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p2qq6" event={"ID":"8acd66fa-2c9b-4f60-a733-886354a893cd","Type":"ContainerStarted","Data":"7a8349e514cb08eeef270cfeb31777cd586be218755b1d0ce817689bef593311"}
Sep 17 09:30:29.965726 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.965684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:29.965919 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:29.965748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:29.965919 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.965849    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:30:29.965919 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.965915    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:31.965899558 +0000 UTC m=+37.032111324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:30:29.966091 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.965847    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:30:29.966091 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.965963    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:30:29.966091 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:29.966024    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:31.966010466 +0000 UTC m=+37.032222209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:30:31.619108 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:31.618925    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d4ec09b-e1ce-4461-bdfd-39f55cff06f4" containerID="5996a495bea6204481441fd82b138f15af62ac7a19caec47b241a6283a45e179" exitCode=0
Sep 17 09:30:31.619563 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:31.619011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerDied","Data":"5996a495bea6204481441fd82b138f15af62ac7a19caec47b241a6283a45e179"}
Sep 17 09:30:31.986099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:31.986068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:31.986300 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:31.986129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:31.986300 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:31.986249    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:30:31.986300 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:31.986261    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:30:31.986300 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:31.986272    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:30:31.986465 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:31.986316    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:35.986298305 +0000 UTC m=+41.052510067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:30:31.986465 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:31.986342    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:35.986322432 +0000 UTC m=+41.052534207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:30:32.625638 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:32.625555    2558 generic.go:356] "Generic (PLEG): container finished" podID="6d4ec09b-e1ce-4461-bdfd-39f55cff06f4" containerID="144b40cfcc4133dad111aa26c7634343110b8cbe8922b64eaa7d54ccb2c4cd5f" exitCode=0
Sep 17 09:30:32.625638 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:32.625633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerDied","Data":"144b40cfcc4133dad111aa26c7634343110b8cbe8922b64eaa7d54ccb2c4cd5f"}
Sep 17 09:30:33.631375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:33.631268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" event={"ID":"6d4ec09b-e1ce-4461-bdfd-39f55cff06f4","Type":"ContainerStarted","Data":"af3b836400fe95f11e3b89390ea08bb405dda51c3f8c16407fd7cb51f221a64b"}
Sep 17 09:30:33.656222 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:33.656153    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wh6wb" podStartSLOduration=7.875789678 podStartE2EDuration="38.656136848s" totalImagesPullingTime="30.78034717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:33.654789955 +0000 UTC m=+38.721001720" watchObservedRunningTime="2026-09-17 09:30:33.656136848 +0000 UTC m=+38.722348613"
Sep 17 09:30:34.634981 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:34.634946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p2qq6" event={"ID":"8acd66fa-2c9b-4f60-a733-886354a893cd","Type":"ContainerStarted","Data":"a98c58c466105229eb30739dbe1f743a5292a625a443d0183312d0c33a4a8472"}
Sep 17 09:30:34.653575 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:34.653529    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p2qq6" podStartSLOduration=1.89171967 podStartE2EDuration="6.653499282s" totalImagesPullingTime="4.761779612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:34.652463213 +0000 UTC m=+39.718674978" watchObservedRunningTime="2026-09-17 09:30:34.653499282 +0000 UTC m=+39.719711049"
Sep 17 09:30:36.017924 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:36.017882    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:36.018307 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:36.017934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:36.018307 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:36.018024    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:30:36.018307 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:36.018030    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:30:36.018307 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:36.018051    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:30:36.018307 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:36.018075    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:44.018063021 +0000 UTC m=+49.084274763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:30:36.018307 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:36.018093    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:44.018080356 +0000 UTC m=+49.084292100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:30:44.069342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:44.069299    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:30:44.069796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:44.069377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:30:44.069796 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:44.069480    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:30:44.069796 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:44.069552    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:00.069535705 +0000 UTC m=+65.135747452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:30:44.069796 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:44.069483    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:30:44.069796 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:44.069593    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:30:44.069796 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:44.069648    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:00.069635541 +0000 UTC m=+65.135847285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:30:54.449589 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.449542    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"]
Sep 17 09:30:54.452051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.452027    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"
Sep 17 09:30:54.454689 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.454672    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4pvmd\""
Sep 17 09:30:54.464271 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.464251    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"]
Sep 17 09:30:54.552797 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.552760    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ch5ql"]
Sep 17 09:30:54.554828 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.554812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.560872 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.560849    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 09:30:54.561031 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.560910    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rfsld\""
Sep 17 09:30:54.561919 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.561898    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 09:30:54.562004 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.561934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 09:30:54.562004 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.561934    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 09:30:54.566345 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.566328    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 09:30:54.578054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.578033    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ch5ql"]
Sep 17 09:30:54.604685 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.604659    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xfx6s"
Sep 17 09:30:54.645871 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.645836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w94tw\" (UniqueName: \"kubernetes.io/projected/389cac15-7d06-4893-a6c7-9728665f9eb3-kube-api-access-w94tw\") pod \"network-check-source-6f8b768455-cgr5c\" (UID: \"389cac15-7d06-4893-a6c7-9728665f9eb3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"
Sep 17 09:30:54.746416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.746384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w94tw\" (UniqueName: \"kubernetes.io/projected/389cac15-7d06-4893-a6c7-9728665f9eb3-kube-api-access-w94tw\") pod \"network-check-source-6f8b768455-cgr5c\" (UID: \"389cac15-7d06-4893-a6c7-9728665f9eb3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"
Sep 17 09:30:54.746608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.746430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlhb\" (UniqueName: \"kubernetes.io/projected/df5605f0-007b-44a6-bca6-8136488169c8-kube-api-access-rdlhb\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.746608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.746497    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df5605f0-007b-44a6-bca6-8136488169c8-config\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.746608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.746531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df5605f0-007b-44a6-bca6-8136488169c8-trusted-ca\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.746608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.746555    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df5605f0-007b-44a6-bca6-8136488169c8-serving-cert\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.769525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.769493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w94tw\" (UniqueName: \"kubernetes.io/projected/389cac15-7d06-4893-a6c7-9728665f9eb3-kube-api-access-w94tw\") pod \"network-check-source-6f8b768455-cgr5c\" (UID: \"389cac15-7d06-4893-a6c7-9728665f9eb3\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"
Sep 17 09:30:54.847240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.847206    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlhb\" (UniqueName: \"kubernetes.io/projected/df5605f0-007b-44a6-bca6-8136488169c8-kube-api-access-rdlhb\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.847406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.847263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df5605f0-007b-44a6-bca6-8136488169c8-config\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.847406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.847296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df5605f0-007b-44a6-bca6-8136488169c8-trusted-ca\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.847406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.847322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df5605f0-007b-44a6-bca6-8136488169c8-serving-cert\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.847875 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.847850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df5605f0-007b-44a6-bca6-8136488169c8-config\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.848030 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.848012    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/df5605f0-007b-44a6-bca6-8136488169c8-trusted-ca\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.849540 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.849521    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df5605f0-007b-44a6-bca6-8136488169c8-serving-cert\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.855493 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.855473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlhb\" (UniqueName: \"kubernetes.io/projected/df5605f0-007b-44a6-bca6-8136488169c8-kube-api-access-rdlhb\") pod \"console-operator-696884fb9c-ch5ql\" (UID: \"df5605f0-007b-44a6-bca6-8136488169c8\") " pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:54.866317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:54.866300    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:30:55.060467 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:55.060374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"
Sep 17 09:30:55.136932 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:55.136896    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ch5ql"]
Sep 17 09:30:55.139913 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:30:55.139889    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5605f0_007b_44a6_bca6_8136488169c8.slice/crio-750b1bf1c3cbdd0ec2724b6c68957788a175139c64ced3823cd0909f3b7385f4 WatchSource:0}: Error finding container 750b1bf1c3cbdd0ec2724b6c68957788a175139c64ced3823cd0909f3b7385f4: Status 404 returned error can't find the container with id 750b1bf1c3cbdd0ec2724b6c68957788a175139c64ced3823cd0909f3b7385f4
Sep 17 09:30:55.326847 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:55.326767    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c"]
Sep 17 09:30:55.329598 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:30:55.329570    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389cac15_7d06_4893_a6c7_9728665f9eb3.slice/crio-a31b89b9c1350ed971ffc43e09b330e38ac6a6c268c662754546ddf8501d4b6b WatchSource:0}: Error finding container a31b89b9c1350ed971ffc43e09b330e38ac6a6c268c662754546ddf8501d4b6b: Status 404 returned error can't find the container with id a31b89b9c1350ed971ffc43e09b330e38ac6a6c268c662754546ddf8501d4b6b
Sep 17 09:30:55.683150 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:55.683055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c" event={"ID":"389cac15-7d06-4893-a6c7-9728665f9eb3","Type":"ContainerStarted","Data":"a31b89b9c1350ed971ffc43e09b330e38ac6a6c268c662754546ddf8501d4b6b"}
Sep 17 09:30:55.684298 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:55.684269    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" event={"ID":"df5605f0-007b-44a6-bca6-8136488169c8","Type":"ContainerStarted","Data":"750b1bf1c3cbdd0ec2724b6c68957788a175139c64ced3823cd0909f3b7385f4"}
Sep 17 09:30:57.691978 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:57.691894    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/0.log"
Sep 17 09:30:57.691978 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:57.691947    2558 generic.go:356] "Generic (PLEG): container finished" podID="df5605f0-007b-44a6-bca6-8136488169c8" containerID="ea1e961ad850c43f4060ee7c2592240a79160cd599a836e5e8f7c44eb5c508f3" exitCode=255
Sep 17 09:30:57.692510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:57.691980    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" event={"ID":"df5605f0-007b-44a6-bca6-8136488169c8","Type":"ContainerDied","Data":"ea1e961ad850c43f4060ee7c2592240a79160cd599a836e5e8f7c44eb5c508f3"}
Sep 17 09:30:57.692510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:57.692296    2558 scope.go:117] "RemoveContainer" containerID="ea1e961ad850c43f4060ee7c2592240a79160cd599a836e5e8f7c44eb5c508f3"
Sep 17 09:30:58.696373 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.696282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c" event={"ID":"389cac15-7d06-4893-a6c7-9728665f9eb3","Type":"ContainerStarted","Data":"4db4143702b3780cf6da4cff88d59e1d59e700ab056d7d4bcbd8c9c41d95ec2a"}
Sep 17 09:30:58.697837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.697820    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:30:58.698216 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.698201    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/0.log"
Sep 17 09:30:58.698277 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.698234    2558 generic.go:356] "Generic (PLEG): container finished" podID="df5605f0-007b-44a6-bca6-8136488169c8" containerID="8572463c44e416f3b53e65030ac21513908d024406ac67577eea7cb176a5d9f6" exitCode=255
Sep 17 09:30:58.698329 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.698276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" event={"ID":"df5605f0-007b-44a6-bca6-8136488169c8","Type":"ContainerDied","Data":"8572463c44e416f3b53e65030ac21513908d024406ac67577eea7cb176a5d9f6"}
Sep 17 09:30:58.698329 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.698321    2558 scope.go:117] "RemoveContainer" containerID="ea1e961ad850c43f4060ee7c2592240a79160cd599a836e5e8f7c44eb5c508f3"
Sep 17 09:30:58.698512 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.698499    2558 scope.go:117] "RemoveContainer" containerID="8572463c44e416f3b53e65030ac21513908d024406ac67577eea7cb176a5d9f6"
Sep 17 09:30:58.698684 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:58.698661    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ch5ql_openshift-console-operator(df5605f0-007b-44a6-bca6-8136488169c8)\"" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" podUID="df5605f0-007b-44a6-bca6-8136488169c8"
Sep 17 09:30:58.700588 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.700568    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h8fs2"]
Sep 17 09:30:58.703742 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.703718    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.707974 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.707949    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 09:30:58.708086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.708054    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 09:30:58.708224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.708205    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pzmvn\""
Sep 17 09:30:58.709355 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.709337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 09:30:58.709447 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.709365    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 09:30:58.720583 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.720564    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8fs2"]
Sep 17 09:30:58.750485 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.750435    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-cgr5c" podStartSLOduration=1.7330375249999999 podStartE2EDuration="4.750419842s" totalImagesPullingTime="3.017382317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:30:58.72424079 +0000 UTC m=+63.790452555" watchObservedRunningTime="2026-09-17 09:30:58.750419842 +0000 UTC m=+63.816631611"
Sep 17 09:30:58.776662 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.776627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.776823 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.776718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f1e4cba-5232-486f-883c-0290155b0b63-crio-socket\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.776823 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.776805    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f1e4cba-5232-486f-883c-0290155b0b63-data-volume\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.776959 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.776835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9nf\" (UniqueName: \"kubernetes.io/projected/5f1e4cba-5232-486f-883c-0290155b0b63-kube-api-access-9r9nf\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.776959 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.776867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878093 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f1e4cba-5232-486f-883c-0290155b0b63-data-volume\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9nf\" (UniqueName: \"kubernetes.io/projected/5f1e4cba-5232-486f-883c-0290155b0b63-kube-api-access-9r9nf\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878280 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:58.878271    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 09:30:58.878444 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:58.878391    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:59.37831641 +0000 UTC m=+64.444528167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : secret "insights-runtime-extractor-tls" not found
Sep 17 09:30:58.878444 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878429    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f1e4cba-5232-486f-883c-0290155b0b63-crio-socket\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878558 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:58.878534    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 09:30:58.878558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878539    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f1e4cba-5232-486f-883c-0290155b0b63-data-volume\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878675 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.878556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5f1e4cba-5232-486f-883c-0290155b0b63-crio-socket\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:58.878675 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:58.878582    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:30:59.378568668 +0000 UTC m=+64.444780440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : configmap "kube-rbac-proxy" not found
Sep 17 09:30:58.887443 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:58.887421    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9nf\" (UniqueName: \"kubernetes.io/projected/5f1e4cba-5232-486f-883c-0290155b0b63-kube-api-access-9r9nf\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:59.382721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:59.382676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:59.382902 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:59.382792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:30:59.382902 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:59.382798    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 09:30:59.382902 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:59.382876    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:00.38285769 +0000 UTC m=+65.449069457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : configmap "kube-rbac-proxy" not found
Sep 17 09:30:59.382902 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:59.382890    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 09:30:59.383038 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:59.382925    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:00.382915383 +0000 UTC m=+65.449127126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : secret "insights-runtime-extractor-tls" not found
Sep 17 09:30:59.701802 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:59.701719    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:30:59.702188 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:30:59.702127    2558 scope.go:117] "RemoveContainer" containerID="8572463c44e416f3b53e65030ac21513908d024406ac67577eea7cb176a5d9f6"
Sep 17 09:30:59.702295 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:30:59.702276    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ch5ql_openshift-console-operator(df5605f0-007b-44a6-bca6-8136488169c8)\"" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" podUID="df5605f0-007b-44a6-bca6-8136488169c8"
Sep 17 09:31:00.088270 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:00.088233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:31:00.088472 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:00.088319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:31:00.088472 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.088393    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 09:31:00.088472 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.088443    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 09:31:00.088472 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.088455    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69dd7d55cd-bd965: secret "image-registry-tls" not found
Sep 17 09:31:00.088686 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.088479    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls podName:79985231-f3e8-452d-ba6f-b9e91e723e20 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:32.088461194 +0000 UTC m=+97.154672938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls") pod "dns-default-zjm4h" (UID: "79985231-f3e8-452d-ba6f-b9e91e723e20") : secret "dns-default-metrics-tls" not found
Sep 17 09:31:00.088686 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.088504    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls podName:9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:32.088488664 +0000 UTC m=+97.154700435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls") pod "image-registry-69dd7d55cd-bd965" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9") : secret "image-registry-tls" not found
Sep 17 09:31:00.390227 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:00.390128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:00.390227 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:00.390197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:00.390420 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.390267    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:00.390420 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.390341    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:02.390314913 +0000 UTC m=+67.456526661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:00.390420 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.390275    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 09:31:00.390420 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:00.390396    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:02.39038219 +0000 UTC m=+67.456593933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : configmap "kube-rbac-proxy" not found
Sep 17 09:31:00.665047 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:00.664980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5jjl_447b39be-328f-4aa0-beac-192550796811/dns-node-resolver/0.log"
Sep 17 09:31:01.095041 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.094996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:31:01.097619 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.097596    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 09:31:01.108103 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.108083    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6064f505-1120-4de6-b9c5-8f42dde52edc-original-pull-secret\") pod \"global-pull-secret-syncer-q2c7j\" (UID: \"6064f505-1120-4de6-b9c5-8f42dde52edc\") " pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:31:01.195652 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.195609    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:31:01.195652 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.195661    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:31:01.198212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.198191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslbh\" (UniqueName: \"kubernetes.io/projected/ee7916f6-be31-4a69-a45d-9782fd83af26-kube-api-access-cslbh\") pod \"network-check-target-cksrw\" (UID: \"ee7916f6-be31-4a69-a45d-9782fd83af26\") " pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:31:01.198726 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.198711    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 09:31:01.206127 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:01.206102    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 09:31:01.206236 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:01.206186    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs podName:87d3569c-fa7b-4bad-bc42-d7b1869b4c39 nodeName:}" failed. No retries permitted until 2026-09-17 09:32:05.206150661 +0000 UTC m=+130.272362404 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs") pod "network-metrics-daemon-smn2j" (UID: "87d3569c-fa7b-4bad-bc42-d7b1869b4c39") : secret "metrics-daemon-secret" not found
Sep 17 09:31:01.277009 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.276981    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mpw9\""
Sep 17 09:31:01.284665 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.284641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:31:01.285875 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.285857    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q2c7j"
Sep 17 09:31:01.466528 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.466500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b977w_9d211350-a515-4b38-a4a3-f82de45b1476/node-ca/0.log"
Sep 17 09:31:01.566734 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.566654    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cksrw"]
Sep 17 09:31:01.567480 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.567460    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q2c7j"]
Sep 17 09:31:01.568957 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:01.568933    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7916f6_be31_4a69_a45d_9782fd83af26.slice/crio-07dc550c5551a07d2369efac3c1675ac2fa4b5e041fb3a6ba15369d889d42e9c WatchSource:0}: Error finding container 07dc550c5551a07d2369efac3c1675ac2fa4b5e041fb3a6ba15369d889d42e9c: Status 404 returned error can't find the container with id 07dc550c5551a07d2369efac3c1675ac2fa4b5e041fb3a6ba15369d889d42e9c
Sep 17 09:31:01.569542 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:01.569519    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6064f505_1120_4de6_b9c5_8f42dde52edc.slice/crio-42612270c3fadcb4619fc6e027f0ffe372a237ff10741d8551662b0fcf4fcf0f WatchSource:0}: Error finding container 42612270c3fadcb4619fc6e027f0ffe372a237ff10741d8551662b0fcf4fcf0f: Status 404 returned error can't find the container with id 42612270c3fadcb4619fc6e027f0ffe372a237ff10741d8551662b0fcf4fcf0f
Sep 17 09:31:01.707425 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.707390    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2c7j" event={"ID":"6064f505-1120-4de6-b9c5-8f42dde52edc","Type":"ContainerStarted","Data":"42612270c3fadcb4619fc6e027f0ffe372a237ff10741d8551662b0fcf4fcf0f"}
Sep 17 09:31:01.708883 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.708855    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cksrw" event={"ID":"ee7916f6-be31-4a69-a45d-9782fd83af26","Type":"ContainerStarted","Data":"0822640b20bf7be3a969624499964f38c598786e2486a63b2cbff38120170985"}
Sep 17 09:31:01.708996 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.708895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cksrw" event={"ID":"ee7916f6-be31-4a69-a45d-9782fd83af26","Type":"ContainerStarted","Data":"07dc550c5551a07d2369efac3c1675ac2fa4b5e041fb3a6ba15369d889d42e9c"}
Sep 17 09:31:01.708996 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:01.708982    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:31:02.405004 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.404954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:02.405004 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.405011    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:02.405444 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:02.405104    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:02.405444 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:02.405104    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 09:31:02.405444 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:02.405218    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:06.405195831 +0000 UTC m=+71.471407611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:02.405444 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:02.405257    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:06.40524486 +0000 UTC m=+71.471456614 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : configmap "kube-rbac-proxy" not found
Sep 17 09:31:02.465586 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.465559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p2qq6_8acd66fa-2c9b-4f60-a733-886354a893cd/serve-healthcheck-canary/0.log"
Sep 17 09:31:02.770998 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.770943    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cksrw" podStartSLOduration=67.770927916 podStartE2EDuration="1m7.770927916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:01.745876213 +0000 UTC m=+66.812087978" watchObservedRunningTime="2026-09-17 09:31:02.770927916 +0000 UTC m=+67.837139721"
Sep 17 09:31:02.771743 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.771725    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-6k554"]
Sep 17 09:31:02.774763 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.774746    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.778060 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.778038    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 09:31:02.778212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.778154    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 09:31:02.779334 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.779315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tc2cs\""
Sep 17 09:31:02.779450 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.779369    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 09:31:02.779450 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.779401    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 09:31:02.789680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.789652    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-6k554"]
Sep 17 09:31:02.809472 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.809444    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-signing-cabundle\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.809472 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.809474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5wws\" (UniqueName: \"kubernetes.io/projected/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-kube-api-access-r5wws\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.809655 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.809499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-signing-key\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.910805 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.910756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-signing-cabundle\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.910805 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.910802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5wws\" (UniqueName: \"kubernetes.io/projected/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-kube-api-access-r5wws\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.911036 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.910825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-signing-key\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.911604 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.911578    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-signing-cabundle\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.913724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.913696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-signing-key\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:02.921100 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:02.921076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5wws\" (UniqueName: \"kubernetes.io/projected/7e854ff7-6399-4c81-9c26-1cf4f9d158ba-kube-api-access-r5wws\") pod \"service-ca-568869fdc5-6k554\" (UID: \"7e854ff7-6399-4c81-9c26-1cf4f9d158ba\") " pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:03.083555 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:03.083475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-6k554"
Sep 17 09:31:03.359445 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:03.359310    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-6k554"]
Sep 17 09:31:03.363668 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:03.363578    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e854ff7_6399_4c81_9c26_1cf4f9d158ba.slice/crio-fe58cba9b4a4e27b58558c6d08ce77a5a9caae1d9a1ef0e45f15c99870bc1f7d WatchSource:0}: Error finding container fe58cba9b4a4e27b58558c6d08ce77a5a9caae1d9a1ef0e45f15c99870bc1f7d: Status 404 returned error can't find the container with id fe58cba9b4a4e27b58558c6d08ce77a5a9caae1d9a1ef0e45f15c99870bc1f7d
Sep 17 09:31:03.715771 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:03.715742    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-6k554" event={"ID":"7e854ff7-6399-4c81-9c26-1cf4f9d158ba","Type":"ContainerStarted","Data":"fe58cba9b4a4e27b58558c6d08ce77a5a9caae1d9a1ef0e45f15c99870bc1f7d"}
Sep 17 09:31:04.866800 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:04.866764    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:31:04.867228 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:04.866828    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:31:04.867288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:04.867229    2558 scope.go:117] "RemoveContainer" containerID="8572463c44e416f3b53e65030ac21513908d024406ac67577eea7cb176a5d9f6"
Sep 17 09:31:04.867407 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:04.867388    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ch5ql_openshift-console-operator(df5605f0-007b-44a6-bca6-8136488169c8)\"" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" podUID="df5605f0-007b-44a6-bca6-8136488169c8"
Sep 17 09:31:06.442862 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:06.442821    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:06.443324 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:06.442888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:06.443324 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:06.443006    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 09:31:06.443324 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:06.443011    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:06.443324 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:06.443080    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:14.443063491 +0000 UTC m=+79.509275236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : configmap "kube-rbac-proxy" not found
Sep 17 09:31:06.443324 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:06.443097    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:14.443088356 +0000 UTC m=+79.509300099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:07.729839 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:07.729804    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-6k554" event={"ID":"7e854ff7-6399-4c81-9c26-1cf4f9d158ba","Type":"ContainerStarted","Data":"10e55f4897d082c67cf79a5dc9787a819fc1e2d8aa204e39dd1d35b9cb6949c6"}
Sep 17 09:31:07.731363 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:07.731338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q2c7j" event={"ID":"6064f505-1120-4de6-b9c5-8f42dde52edc","Type":"ContainerStarted","Data":"41c365eb1278ffcb2e5a8577ce68e6b010792d637aa2c1605ee046fe836468ce"}
Sep 17 09:31:07.760585 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:07.760533    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-6k554" podStartSLOduration=1.8051291539999998 podStartE2EDuration="5.760515786s" totalImagesPullingTime="3.955386632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:07.75995109 +0000 UTC m=+72.826162854" watchObservedRunningTime="2026-09-17 09:31:07.760515786 +0000 UTC m=+72.826727551"
Sep 17 09:31:07.786913 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:07.786855    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q2c7j" podStartSLOduration=67.0260698 podStartE2EDuration="1m12.7868405s" totalImagesPullingTime="5.7607707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:07.785010868 +0000 UTC m=+72.851222630" watchObservedRunningTime="2026-09-17 09:31:07.7868405 +0000 UTC m=+72.853052264"
Sep 17 09:31:14.507828 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:14.507775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:14.508257 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:14.507859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:14.508257 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:14.507933    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:14.508257 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:14.508009    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls podName:5f1e4cba-5232-486f-883c-0290155b0b63 nodeName:}" failed. No retries permitted until 2026-09-17 09:31:30.507992986 +0000 UTC m=+95.574204736 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h8fs2" (UID: "5f1e4cba-5232-486f-883c-0290155b0b63") : secret "insights-runtime-extractor-tls" not found
Sep 17 09:31:14.508401 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:14.508380    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5f1e4cba-5232-486f-883c-0290155b0b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:17.455992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:17.455957    2558 scope.go:117] "RemoveContainer" containerID="8572463c44e416f3b53e65030ac21513908d024406ac67577eea7cb176a5d9f6"
Sep 17 09:31:17.764795 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:17.764767    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:31:17.765035 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:17.764848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" event={"ID":"df5605f0-007b-44a6-bca6-8136488169c8","Type":"ContainerStarted","Data":"1856e9cfd2058de0915337d4972107b2be4e91e6e5913fa732ae057c6940926a"}
Sep 17 09:31:17.765133 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:17.765113    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:31:17.784289 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:17.784231    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql" podStartSLOduration=21.704610052 podStartE2EDuration="23.784215038s" totalImagesPullingTime="2.079604986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:17.783221164 +0000 UTC m=+82.849432938" watchObservedRunningTime="2026-09-17 09:31:17.784215038 +0000 UTC m=+82.850426803"
Sep 17 09:31:18.341866 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:18.341834    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-ch5ql"
Sep 17 09:31:28.098110 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.098070    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"]
Sep 17 09:31:28.102796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.102772    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"]
Sep 17 09:31:28.102938 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.102900    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.106768 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.106740    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 09:31:28.107968 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.107908    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 09:31:28.108471 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.108446    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 09:31:28.108880 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.108605    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 09:31:28.108880 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.108606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 09:31:28.108880 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.108715    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 09:31:28.109063 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.108896    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 09:31:28.110595 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.110574    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.114776 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.114747    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wqqm8\""
Sep 17 09:31:28.115431 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.115416    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 09:31:28.115620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.115605    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 09:31:28.120996 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.120976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"]
Sep 17 09:31:28.121779 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.121759    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"]
Sep 17 09:31:28.211219 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-hub\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.211390 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-ca\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.211390 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2616cf3e-1a5f-4e12-afea-19b95b7f41b9-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-ps8xp\" (UID: \"2616cf3e-1a5f-4e12-afea-19b95b7f41b9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.211390 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211294    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.211390 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.211525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2616cf3e-1a5f-4e12-afea-19b95b7f41b9-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-ps8xp\" (UID: \"2616cf3e-1a5f-4e12-afea-19b95b7f41b9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.211525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae25e6e4-2fc6-426b-abae-0fccd6081298-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.211525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.211474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwwng\" (UniqueName: \"kubernetes.io/projected/ae25e6e4-2fc6-426b-abae-0fccd6081298-kube-api-access-kwwng\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.312210 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-hub\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.312407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312230    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-ca\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.312407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312252    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2616cf3e-1a5f-4e12-afea-19b95b7f41b9-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-ps8xp\" (UID: \"2616cf3e-1a5f-4e12-afea-19b95b7f41b9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.312407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312274    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.312407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.312407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2616cf3e-1a5f-4e12-afea-19b95b7f41b9-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-ps8xp\" (UID: \"2616cf3e-1a5f-4e12-afea-19b95b7f41b9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.312667 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae25e6e4-2fc6-426b-abae-0fccd6081298-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.312667 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.312438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwwng\" (UniqueName: \"kubernetes.io/projected/ae25e6e4-2fc6-426b-abae-0fccd6081298-kube-api-access-kwwng\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.313244 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.313213    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2616cf3e-1a5f-4e12-afea-19b95b7f41b9-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-ps8xp\" (UID: \"2616cf3e-1a5f-4e12-afea-19b95b7f41b9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.313244 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.313235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae25e6e4-2fc6-426b-abae-0fccd6081298-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.314913 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.314880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-ca\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.315061 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.315034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.315157 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.315141    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-hub\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.315262 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.315211    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2616cf3e-1a5f-4e12-afea-19b95b7f41b9-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-ps8xp\" (UID: \"2616cf3e-1a5f-4e12-afea-19b95b7f41b9\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.315741 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.315720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae25e6e4-2fc6-426b-abae-0fccd6081298-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.323535 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.323508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwwng\" (UniqueName: \"kubernetes.io/projected/ae25e6e4-2fc6-426b-abae-0fccd6081298-kube-api-access-kwwng\") pod \"cluster-proxy-proxy-agent-85895c7bdc-z2w8c\" (UID: \"ae25e6e4-2fc6-426b-abae-0fccd6081298\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.424373 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.424277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"
Sep 17 09:31:28.430417 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.430385    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"
Sep 17 09:31:28.725614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.725589    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c"]
Sep 17 09:31:28.727862 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:28.727826    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae25e6e4_2fc6_426b_abae_0fccd6081298.slice/crio-3a0fc43de67db2e49ecd268e3b2ca58e10f81fe506272eac9d94bc787d93af84 WatchSource:0}: Error finding container 3a0fc43de67db2e49ecd268e3b2ca58e10f81fe506272eac9d94bc787d93af84: Status 404 returned error can't find the container with id 3a0fc43de67db2e49ecd268e3b2ca58e10f81fe506272eac9d94bc787d93af84
Sep 17 09:31:28.745265 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.745239    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp"]
Sep 17 09:31:28.748258 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:28.748230    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2616cf3e_1a5f_4e12_afea_19b95b7f41b9.slice/crio-1f24e56c4ce5530ac8f03d5474daa58744f25d305ef88e86848664f633bfa820 WatchSource:0}: Error finding container 1f24e56c4ce5530ac8f03d5474daa58744f25d305ef88e86848664f633bfa820: Status 404 returned error can't find the container with id 1f24e56c4ce5530ac8f03d5474daa58744f25d305ef88e86848664f633bfa820
Sep 17 09:31:28.798298 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.798261    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c" event={"ID":"ae25e6e4-2fc6-426b-abae-0fccd6081298","Type":"ContainerStarted","Data":"3a0fc43de67db2e49ecd268e3b2ca58e10f81fe506272eac9d94bc787d93af84"}
Sep 17 09:31:28.799497 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:28.799474    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp" event={"ID":"2616cf3e-1a5f-4e12-afea-19b95b7f41b9","Type":"ContainerStarted","Data":"1f24e56c4ce5530ac8f03d5474daa58744f25d305ef88e86848664f633bfa820"}
Sep 17 09:31:30.532339 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:30.531789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:30.534544 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:30.534491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5f1e4cba-5232-486f-883c-0290155b0b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h8fs2\" (UID: \"5f1e4cba-5232-486f-883c-0290155b0b63\") " pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:30.809631 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:30.809541    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp" event={"ID":"2616cf3e-1a5f-4e12-afea-19b95b7f41b9","Type":"ContainerStarted","Data":"2578e1b03790018df7074fde5ec705e867027dbe188f5d2d715dda1667a029f3"}
Sep 17 09:31:30.818175 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:30.818119    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h8fs2"
Sep 17 09:31:30.836582 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:30.836521    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-ps8xp" podStartSLOduration=1.302680275 podStartE2EDuration="2.836501581s" totalImagesPullingTime="1.533821306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:30.836051337 +0000 UTC m=+95.902263103" watchObservedRunningTime="2026-09-17 09:31:30.836501581 +0000 UTC m=+95.902713350"
Sep 17 09:31:31.489869 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:31.489685    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h8fs2"]
Sep 17 09:31:32.147697 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.147660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:31:32.148156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.147723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:31:32.150387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.150361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"image-registry-69dd7d55cd-bd965\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") " pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:31:32.150700 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.150675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79985231-f3e8-452d-ba6f-b9e91e723e20-metrics-tls\") pod \"dns-default-zjm4h\" (UID: \"79985231-f3e8-452d-ba6f-b9e91e723e20\") " pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:31:32.181721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.181691    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q8zp\""
Sep 17 09:31:32.189762 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.189722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:31:32.201448 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.201423    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lx2nq\""
Sep 17 09:31:32.209133 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.209107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:31:32.420882 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:32.420816    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1e4cba_5232_486f_883c_0290155b0b63.slice/crio-0ff3483a26b8583f81c9db7a20449fd0ff84e0d3d22447dc2f8167067aae7f52 WatchSource:0}: Error finding container 0ff3483a26b8583f81c9db7a20449fd0ff84e0d3d22447dc2f8167067aae7f52: Status 404 returned error can't find the container with id 0ff3483a26b8583f81c9db7a20449fd0ff84e0d3d22447dc2f8167067aae7f52
Sep 17 09:31:32.702526 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.702440    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zjm4h"]
Sep 17 09:31:32.705558 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:32.705529    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79985231_f3e8_452d_ba6f_b9e91e723e20.slice/crio-4c2947836804d496e17d938e468fbc4b0c3e7028ba6dab5c3f7a9641b09d49a5 WatchSource:0}: Error finding container 4c2947836804d496e17d938e468fbc4b0c3e7028ba6dab5c3f7a9641b09d49a5: Status 404 returned error can't find the container with id 4c2947836804d496e17d938e468fbc4b0c3e7028ba6dab5c3f7a9641b09d49a5
Sep 17 09:31:32.705680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.705651    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69dd7d55cd-bd965"]
Sep 17 09:31:32.708079 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:32.708059    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae5a0fa_e4b1_4951_b578_cfc08c6f82c9.slice/crio-787de7c6484185c4ce8e9ad768113dbbd07ffd2610643ee0326a521cc15c5ec6 WatchSource:0}: Error finding container 787de7c6484185c4ce8e9ad768113dbbd07ffd2610643ee0326a521cc15c5ec6: Status 404 returned error can't find the container with id 787de7c6484185c4ce8e9ad768113dbbd07ffd2610643ee0326a521cc15c5ec6
Sep 17 09:31:32.714602 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.714586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cksrw"
Sep 17 09:31:32.817810 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.817773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zjm4h" event={"ID":"79985231-f3e8-452d-ba6f-b9e91e723e20","Type":"ContainerStarted","Data":"4c2947836804d496e17d938e468fbc4b0c3e7028ba6dab5c3f7a9641b09d49a5"}
Sep 17 09:31:32.819450 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.819422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8fs2" event={"ID":"5f1e4cba-5232-486f-883c-0290155b0b63","Type":"ContainerStarted","Data":"c16ae90f607c07d7e6386634a51efec26eb6763df42c80900a6a8533e74fc210"}
Sep 17 09:31:32.819572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.819483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8fs2" event={"ID":"5f1e4cba-5232-486f-883c-0290155b0b63","Type":"ContainerStarted","Data":"0ff3483a26b8583f81c9db7a20449fd0ff84e0d3d22447dc2f8167067aae7f52"}
Sep 17 09:31:32.821592 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.821565    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c" event={"ID":"ae25e6e4-2fc6-426b-abae-0fccd6081298","Type":"ContainerStarted","Data":"2991fd26c26c27e55314ab15a905e78f092baca89ff15210c9782c00cd1ce52e"}
Sep 17 09:31:32.821678 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.821606    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c" event={"ID":"ae25e6e4-2fc6-426b-abae-0fccd6081298","Type":"ContainerStarted","Data":"200fc4229ab796d7ffc976f5ed82b26782e762b6a2859265059f504454acbffa"}
Sep 17 09:31:32.821678 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.821625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c" event={"ID":"ae25e6e4-2fc6-426b-abae-0fccd6081298","Type":"ContainerStarted","Data":"cd18b6a0a4ea56ff5083f19b889c299aa14001ea765cdaffad59bf1f10f7ff89"}
Sep 17 09:31:32.823058 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.823035    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965" event={"ID":"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9","Type":"ContainerStarted","Data":"d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1"}
Sep 17 09:31:32.823144 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.823079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965" event={"ID":"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9","Type":"ContainerStarted","Data":"787de7c6484185c4ce8e9ad768113dbbd07ffd2610643ee0326a521cc15c5ec6"}
Sep 17 09:31:32.823208 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.823187    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:31:32.842436 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.842369    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85895c7bdc-z2w8c" podStartSLOduration=1.099378865 podStartE2EDuration="4.842350505s" totalImagesPullingTime="3.74297164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:32.841408028 +0000 UTC m=+97.907619803" watchObservedRunningTime="2026-09-17 09:31:32.842350505 +0000 UTC m=+97.908562271"
Sep 17 09:31:32.870887 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:32.870837    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965" podStartSLOduration=97.870820117 podStartE2EDuration="1m37.870820117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:32.868355638 +0000 UTC m=+97.934567402" watchObservedRunningTime="2026-09-17 09:31:32.870820117 +0000 UTC m=+97.937031873"
Sep 17 09:31:33.828947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:33.828872    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8fs2" event={"ID":"5f1e4cba-5232-486f-883c-0290155b0b63","Type":"ContainerStarted","Data":"88233650334c74cc2cc22a5cd74862e7d61767216966f7388a807980c928f5a5"}
Sep 17 09:31:35.837993 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:35.837955    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zjm4h" event={"ID":"79985231-f3e8-452d-ba6f-b9e91e723e20","Type":"ContainerStarted","Data":"46db41f03866f6a51907fc07d8d53f891e71c10ec6f605b10d8a4d638a92e4ac"}
Sep 17 09:31:35.838487 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:35.838011    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zjm4h" event={"ID":"79985231-f3e8-452d-ba6f-b9e91e723e20","Type":"ContainerStarted","Data":"fe2727c26703d48abde44cc1ec19a580ab15dacc2e17fd32bb5ced228607e36f"}
Sep 17 09:31:35.838487 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:35.838080    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:31:35.840069 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:35.840043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h8fs2" event={"ID":"5f1e4cba-5232-486f-883c-0290155b0b63","Type":"ContainerStarted","Data":"03e6458b11c259df4373a9a3a93e809423e23350e2862a7ac6bf1507cfd70ace"}
Sep 17 09:31:35.861322 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:35.861254    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zjm4h" podStartSLOduration=65.660909372 podStartE2EDuration="1m7.861235301s" totalImagesPullingTime="2.200325929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:35.861048233 +0000 UTC m=+100.927259996" watchObservedRunningTime="2026-09-17 09:31:35.861235301 +0000 UTC m=+100.927447064"
Sep 17 09:31:35.888526 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:35.888471    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h8fs2" podStartSLOduration=35.567989557 podStartE2EDuration="37.888457852s" totalImagesPullingTime="2.320468295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 09:30:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:35.888071755 +0000 UTC m=+100.954283519" watchObservedRunningTime="2026-09-17 09:31:35.888457852 +0000 UTC m=+100.954669617"
Sep 17 09:31:37.539977 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.539940    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cxfxk"]
Sep 17 09:31:37.546224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.546193    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.550539 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.550512    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 09:31:37.551290 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.550834    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 09:31:37.551290 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.551192    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 09:31:37.551490 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.551418    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 09:31:37.551822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.551805    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 09:31:37.551939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.551865    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 09:31:37.552315 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.552298    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x4lg6\""
Sep 17 09:31:37.697354 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-textfile\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-sys\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-tls\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697507    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dfrj\" (UniqueName: \"kubernetes.io/projected/7228663a-7f02-4afb-9ff0-236b802153ba-kube-api-access-5dfrj\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697794 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7228663a-7f02-4afb-9ff0-236b802153ba-metrics-client-ca\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697794 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-wtmp\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.697794 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.697590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-root\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7228663a-7f02-4afb-9ff0-236b802153ba-metrics-client-ca\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-wtmp\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-root\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-root\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798732    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-wtmp\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-textfile\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.798909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-sys\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.799228 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-tls\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.799228 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.798973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dfrj\" (UniqueName: \"kubernetes.io/projected/7228663a-7f02-4afb-9ff0-236b802153ba-kube-api-access-5dfrj\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.799228 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.799028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-textfile\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.799375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.799229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7228663a-7f02-4afb-9ff0-236b802153ba-metrics-client-ca\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.799375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.799297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7228663a-7f02-4afb-9ff0-236b802153ba-sys\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.799470 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:37.799382    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 09:31:37.799470 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:31:37.799437    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-tls podName:7228663a-7f02-4afb-9ff0-236b802153ba nodeName:}" failed. No retries permitted until 2026-09-17 09:31:38.299418698 +0000 UTC m=+103.365630448 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-tls") pod "node-exporter-cxfxk" (UID: "7228663a-7f02-4afb-9ff0-236b802153ba") : secret "node-exporter-tls" not found
Sep 17 09:31:37.799580 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.799499    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.802154 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.802127    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:37.819409 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:37.819370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dfrj\" (UniqueName: \"kubernetes.io/projected/7228663a-7f02-4afb-9ff0-236b802153ba-kube-api-access-5dfrj\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:38.304449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:38.304407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-tls\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:38.306770 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:38.306737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7228663a-7f02-4afb-9ff0-236b802153ba-node-exporter-tls\") pod \"node-exporter-cxfxk\" (UID: \"7228663a-7f02-4afb-9ff0-236b802153ba\") " pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:38.457007 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:38.456956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxfxk"
Sep 17 09:31:38.468662 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:38.468635    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7228663a_7f02_4afb_9ff0_236b802153ba.slice/crio-41d1e73d0b23f45ecb74847a804859fa4cd12fa32d2c0c3ac485a9fa5d87af4a WatchSource:0}: Error finding container 41d1e73d0b23f45ecb74847a804859fa4cd12fa32d2c0c3ac485a9fa5d87af4a: Status 404 returned error can't find the container with id 41d1e73d0b23f45ecb74847a804859fa4cd12fa32d2c0c3ac485a9fa5d87af4a
Sep 17 09:31:38.853594 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:38.853547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxfxk" event={"ID":"7228663a-7f02-4afb-9ff0-236b802153ba","Type":"ContainerStarted","Data":"41d1e73d0b23f45ecb74847a804859fa4cd12fa32d2c0c3ac485a9fa5d87af4a"}
Sep 17 09:31:39.861385 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:39.861349    2558 generic.go:356] "Generic (PLEG): container finished" podID="7228663a-7f02-4afb-9ff0-236b802153ba" containerID="41f635cf2d965c4670391ef0d1e23cce000d6afb6b5c39ab529b92457c0d8939" exitCode=0
Sep 17 09:31:39.861822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:39.861395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxfxk" event={"ID":"7228663a-7f02-4afb-9ff0-236b802153ba","Type":"ContainerDied","Data":"41f635cf2d965c4670391ef0d1e23cce000d6afb6b5c39ab529b92457c0d8939"}
Sep 17 09:31:40.867757 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:40.867717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxfxk" event={"ID":"7228663a-7f02-4afb-9ff0-236b802153ba","Type":"ContainerStarted","Data":"efa7b4c40d4c6cbce582e9e7e1884b6b8dccf12e161358033e35e2b8d6342336"}
Sep 17 09:31:40.868254 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:40.867774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxfxk" event={"ID":"7228663a-7f02-4afb-9ff0-236b802153ba","Type":"ContainerStarted","Data":"a2984b8e7a7018ab63b0afb6a75f46185de94363efd6d49df2991c8de9c92718"}
Sep 17 09:31:40.904580 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:40.904522    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cxfxk" podStartSLOduration=3.034690629 podStartE2EDuration="3.904503239s" totalImagesPullingTime="807.550814ms" totalInitContainerRuntime="62.261796ms" isStatefulPod=true podCreationTimestamp="2026-09-17 09:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:40.904056763 +0000 UTC m=+105.970268531" watchObservedRunningTime="2026-09-17 09:31:40.904503239 +0000 UTC m=+105.970715106"
Sep 17 09:31:45.845920 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:45.845888    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zjm4h"
Sep 17 09:31:51.615074 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:51.615040    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69dd7d55cd-bd965"]
Sep 17 09:31:51.619633 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:51.619606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:31:52.820177 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.820132    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7685775585-9xbzq"]
Sep 17 09:31:52.823201 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.823184    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.839361 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.839328    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 09:31:52.839504 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.839406    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 09:31:52.840525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.840491    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 09:31:52.840636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.840561    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 09:31:52.841310 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.841286    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 09:31:52.845605 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.845592    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wqzd4\""
Sep 17 09:31:52.848457 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.848443    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 09:31:52.849591 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.849577    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 09:31:52.852401 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.852387    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 09:31:52.863499 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.863477    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7685775585-9xbzq"]
Sep 17 09:31:52.923384 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt442\" (UniqueName: \"kubernetes.io/projected/78df4ff9-4aa8-4070-90d6-b494a057f0f7-kube-api-access-pt442\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.923569 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-serving-cert\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.923569 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-oauth-config\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.923569 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-service-ca\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.923569 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-oauth-serving-cert\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.923711 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-trusted-ca-bundle\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:52.923711 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:52.923610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-config\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.024943 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.024909    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-config\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.024968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt442\" (UniqueName: \"kubernetes.io/projected/78df4ff9-4aa8-4070-90d6-b494a057f0f7-kube-api-access-pt442\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-serving-cert\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-oauth-config\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-service-ca\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-oauth-serving-cert\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025399 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-trusted-ca-bundle\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025840 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-config\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.025840 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-service-ca\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.026030 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-oauth-serving-cert\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.026030 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.025907    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-trusted-ca-bundle\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.027585 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.027554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-serving-cert\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.027682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.027604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-oauth-config\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.039326 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.039307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt442\" (UniqueName: \"kubernetes.io/projected/78df4ff9-4aa8-4070-90d6-b494a057f0f7-kube-api-access-pt442\") pod \"console-7685775585-9xbzq\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") " pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.132199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.132083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:31:53.417905 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.417806    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7685775585-9xbzq"]
Sep 17 09:31:53.422623 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:31:53.422591    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78df4ff9_4aa8_4070_90d6_b494a057f0f7.slice/crio-3b39c5d00d0748bff8e63070ae258f45a6e5666c13c9c52130f076efb8b3aa45 WatchSource:0}: Error finding container 3b39c5d00d0748bff8e63070ae258f45a6e5666c13c9c52130f076efb8b3aa45: Status 404 returned error can't find the container with id 3b39c5d00d0748bff8e63070ae258f45a6e5666c13c9c52130f076efb8b3aa45
Sep 17 09:31:53.916440 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:53.916402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7685775585-9xbzq" event={"ID":"78df4ff9-4aa8-4070-90d6-b494a057f0f7","Type":"ContainerStarted","Data":"3b39c5d00d0748bff8e63070ae258f45a6e5666c13c9c52130f076efb8b3aa45"}
Sep 17 09:31:56.930464 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:56.930431    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7685775585-9xbzq" event={"ID":"78df4ff9-4aa8-4070-90d6-b494a057f0f7","Type":"ContainerStarted","Data":"91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645"}
Sep 17 09:31:56.951974 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:31:56.951922    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7685775585-9xbzq" podStartSLOduration=2.166346775 podStartE2EDuration="4.951906871s" totalImagesPullingTime="2.785560096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:31:56.951362258 +0000 UTC m=+122.017574022" watchObservedRunningTime="2026-09-17 09:31:56.951906871 +0000 UTC m=+122.018118637"
Sep 17 09:32:03.132703 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:03.132650    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:32:03.133346 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:03.132735    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:32:03.137389 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:03.137364    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:32:03.960151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:03.960119    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:32:05.217767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:05.217724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:32:05.220070 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:05.220050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87d3569c-fa7b-4bad-bc42-d7b1869b4c39-metrics-certs\") pod \"network-metrics-daemon-smn2j\" (UID: \"87d3569c-fa7b-4bad-bc42-d7b1869b4c39\") " pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:32:05.484396 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:05.484305    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5k2bt\""
Sep 17 09:32:05.490761 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:05.490737    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-smn2j"
Sep 17 09:32:05.832998 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:05.832966    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-smn2j"]
Sep 17 09:32:05.835820 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:32:05.835778    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d3569c_fa7b_4bad_bc42_d7b1869b4c39.slice/crio-f6a52ee16db7b64fc2fd1289234b1fbdfdba62ec2266be0eaf3bc1461c00563c WatchSource:0}: Error finding container f6a52ee16db7b64fc2fd1289234b1fbdfdba62ec2266be0eaf3bc1461c00563c: Status 404 returned error can't find the container with id f6a52ee16db7b64fc2fd1289234b1fbdfdba62ec2266be0eaf3bc1461c00563c
Sep 17 09:32:05.964078 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:05.964040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smn2j" event={"ID":"87d3569c-fa7b-4bad-bc42-d7b1869b4c39","Type":"ContainerStarted","Data":"f6a52ee16db7b64fc2fd1289234b1fbdfdba62ec2266be0eaf3bc1461c00563c"}
Sep 17 09:32:07.974429 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:07.974384    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smn2j" event={"ID":"87d3569c-fa7b-4bad-bc42-d7b1869b4c39","Type":"ContainerStarted","Data":"586ab5365465f07a42d6f3df342027f4acc4016ef99ffc9789cf5e379ee10c19"}
Sep 17 09:32:07.974916 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:07.974454    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-smn2j" event={"ID":"87d3569c-fa7b-4bad-bc42-d7b1869b4c39","Type":"ContainerStarted","Data":"d6514a961256e738519ef4e5ae5d37bdef5a57482f6e23600cdb369400d7c8d8"}
Sep 17 09:32:07.995031 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:07.994983    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-smn2j" podStartSLOduration=131.663431515 podStartE2EDuration="2m12.994968157s" totalImagesPullingTime="1.331536642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:32:07.99291563 +0000 UTC m=+133.059127394" watchObservedRunningTime="2026-09-17 09:32:07.994968157 +0000 UTC m=+133.061179921"
Sep 17 09:32:16.634413 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:16.634365    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965" podUID="9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" containerName="registry" containerID="cri-o://d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1" gracePeriod=30
Sep 17 09:32:16.901737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:16.901711    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:32:17.006024 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.005943    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-image-registry-private-configuration\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006024 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006002    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-ca-trust-extracted\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006024 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxwbh\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-kube-api-access-lxwbh\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006078    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-certificates\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006118    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-bound-sa-token\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006150    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006219    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-installation-pull-secrets\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006261    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-trusted-ca\") pod \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\" (UID: \"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9\") "
Sep 17 09:32:17.006901 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.006609    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:32:17.008837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.008083    2558 generic.go:356] "Generic (PLEG): container finished" podID="9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" containerID="d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1" exitCode=0
Sep 17 09:32:17.008837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.008220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965" event={"ID":"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9","Type":"ContainerDied","Data":"d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1"}
Sep 17 09:32:17.008837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.008266    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965" event={"ID":"9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9","Type":"ContainerDied","Data":"787de7c6484185c4ce8e9ad768113dbbd07ffd2610643ee0326a521cc15c5ec6"}
Sep 17 09:32:17.008837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.008289    2558 scope.go:117] "RemoveContainer" containerID="d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1"
Sep 17 09:32:17.008837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.008450    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69dd7d55cd-bd965"
Sep 17 09:32:17.009139 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.009014    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:32:17.021420 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.011838    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-kube-api-access-lxwbh" (OuterVolumeSpecName: "kube-api-access-lxwbh") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "kube-api-access-lxwbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:32:17.021420 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.011917    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:32:17.021420 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.012051    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:32:17.021420 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.012111    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:32:17.021420 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.019686    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:32:17.025910 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.025871    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" (UID: "9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:32:17.029260 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.029238    2558 scope.go:117] "RemoveContainer" containerID="d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1"
Sep 17 09:32:17.029629 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:32:17.029609    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1\": container with ID starting with d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1 not found: ID does not exist" containerID="d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1"
Sep 17 09:32:17.029710 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.029642    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1"} err="failed to get container status \"d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1\": rpc error: code = NotFound desc = could not find container \"d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1\": container with ID starting with d007cf2e024b44b091b09707a32846e3b847f0a8374079d1246c14e582e760d1 not found: ID does not exist"
Sep 17 09:32:17.107481 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107439    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-certificates\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107481 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107481    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-bound-sa-token\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107495    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107506    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-installation-pull-secrets\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107518    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-trusted-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107530    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-image-registry-private-configuration\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107545    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-ca-trust-extracted\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.107724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.107556    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxwbh\" (UniqueName: \"kubernetes.io/projected/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9-kube-api-access-lxwbh\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:32:17.338739 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.338708    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69dd7d55cd-bd965"]
Sep 17 09:32:17.343357 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.343320    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69dd7d55cd-bd965"]
Sep 17 09:32:17.460430 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:32:17.460401    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" path="/var/lib/kubelet/pods/9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9/volumes"
Sep 17 09:33:18.595437 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.595399    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69c5fbf686-ndr6w"]
Sep 17 09:33:18.596093 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.595645    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" containerName="registry"
Sep 17 09:33:18.596093 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.595657    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" containerName="registry"
Sep 17 09:33:18.596093 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.595721    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae5a0fa-e4b1-4951-b578-cfc08c6f82c9" containerName="registry"
Sep 17 09:33:18.598367 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.598346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.615877 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.615848    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c5fbf686-ndr6w"]
Sep 17 09:33:18.640326 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-service-ca\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.640326 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-config\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.640480 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-oauth-serving-cert\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.640480 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-trusted-ca-bundle\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.640480 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-oauth-config\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.640480 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mqz4\" (UniqueName: \"kubernetes.io/projected/5cd8a511-3140-41f7-a5ab-242c3bbc1704-kube-api-access-7mqz4\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.640480 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.640472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-serving-cert\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741029 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.740996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-serving-cert\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741234 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-service-ca\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741234 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-config\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741234 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-oauth-serving-cert\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741234 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-trusted-ca-bundle\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741350    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-oauth-config\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mqz4\" (UniqueName: \"kubernetes.io/projected/5cd8a511-3140-41f7-a5ab-242c3bbc1704-kube-api-access-7mqz4\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.741889 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741862    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-service-ca\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.742081 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-config\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.742192 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.741991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-oauth-serving-cert\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.742254 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.742239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-trusted-ca-bundle\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.743582 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.743564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-serving-cert\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.743674 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.743653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-oauth-config\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.753209 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.753191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mqz4\" (UniqueName: \"kubernetes.io/projected/5cd8a511-3140-41f7-a5ab-242c3bbc1704-kube-api-access-7mqz4\") pod \"console-69c5fbf686-ndr6w\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") " pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:18.907806 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:18.907714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:19.183993 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:19.183897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c5fbf686-ndr6w"]
Sep 17 09:33:19.187596 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:33:19.187570    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd8a511_3140_41f7_a5ab_242c3bbc1704.slice/crio-d4f415025ef9b94e4bd5007fb5a2fcc0be02aa21f1938ae63d47a7787b203128 WatchSource:0}: Error finding container d4f415025ef9b94e4bd5007fb5a2fcc0be02aa21f1938ae63d47a7787b203128: Status 404 returned error can't find the container with id d4f415025ef9b94e4bd5007fb5a2fcc0be02aa21f1938ae63d47a7787b203128
Sep 17 09:33:19.223355 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:19.223329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5fbf686-ndr6w" event={"ID":"5cd8a511-3140-41f7-a5ab-242c3bbc1704","Type":"ContainerStarted","Data":"d4f415025ef9b94e4bd5007fb5a2fcc0be02aa21f1938ae63d47a7787b203128"}
Sep 17 09:33:20.228193 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:20.228140    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5fbf686-ndr6w" event={"ID":"5cd8a511-3140-41f7-a5ab-242c3bbc1704","Type":"ContainerStarted","Data":"7e2f32c04f2d76c9b289e8b67f8d22196d2abcf46abc393086633d69fd156bb3"}
Sep 17 09:33:20.252494 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:20.252451    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69c5fbf686-ndr6w" podStartSLOduration=2.252437576 podStartE2EDuration="2.252437576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:33:20.250734584 +0000 UTC m=+205.316946350" watchObservedRunningTime="2026-09-17 09:33:20.252437576 +0000 UTC m=+205.318649399"
Sep 17 09:33:28.908847 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:28.908805    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:28.909502 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:28.908888    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:28.913334 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:28.913310    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:29.264689 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:29.264661    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:33:29.321046 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:29.321018    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7685775585-9xbzq"]
Sep 17 09:33:54.341381 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.341311    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7685775585-9xbzq" podUID="78df4ff9-4aa8-4070-90d6-b494a057f0f7" containerName="console" containerID="cri-o://91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645" gracePeriod=15
Sep 17 09:33:54.573712 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.573689    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:33:54.694449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694367    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-serving-cert\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694399    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-trusted-ca-bundle\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694437    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt442\" (UniqueName: \"kubernetes.io/projected/78df4ff9-4aa8-4070-90d6-b494a057f0f7-kube-api-access-pt442\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-service-ca\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694492    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-config\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694522    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-oauth-config\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694559    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-oauth-serving-cert\") pod \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\" (UID: \"78df4ff9-4aa8-4070-90d6-b494a057f0f7\") "
Sep 17 09:33:54.694972 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694945    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-config" (OuterVolumeSpecName: "console-config") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:33:54.695038 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694949    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:33:54.695038 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694954    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:33:54.695038 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.694990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:33:54.696771 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.696741    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:33:54.696771 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.696760    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:33:54.696917 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.696833    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78df4ff9-4aa8-4070-90d6-b494a057f0f7-kube-api-access-pt442" (OuterVolumeSpecName: "kube-api-access-pt442") pod "78df4ff9-4aa8-4070-90d6-b494a057f0f7" (UID: "78df4ff9-4aa8-4070-90d6-b494a057f0f7"). InnerVolumeSpecName "kube-api-access-pt442". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:33:54.795618 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795584    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-service-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:54.795618 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795611    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:54.795618 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795620    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-oauth-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:54.795618 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795629    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-oauth-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:54.795858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795638    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78df4ff9-4aa8-4070-90d6-b494a057f0f7-console-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:54.795858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795646    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78df4ff9-4aa8-4070-90d6-b494a057f0f7-trusted-ca-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:54.795858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:54.795654    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt442\" (UniqueName: \"kubernetes.io/projected/78df4ff9-4aa8-4070-90d6-b494a057f0f7-kube-api-access-pt442\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:33:55.349913 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.349877    2558 generic.go:356] "Generic (PLEG): container finished" podID="78df4ff9-4aa8-4070-90d6-b494a057f0f7" containerID="91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645" exitCode=0
Sep 17 09:33:55.350344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.349931    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7685775585-9xbzq"
Sep 17 09:33:55.350344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.349952    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7685775585-9xbzq" event={"ID":"78df4ff9-4aa8-4070-90d6-b494a057f0f7","Type":"ContainerDied","Data":"91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645"}
Sep 17 09:33:55.350344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.350012    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7685775585-9xbzq" event={"ID":"78df4ff9-4aa8-4070-90d6-b494a057f0f7","Type":"ContainerDied","Data":"3b39c5d00d0748bff8e63070ae258f45a6e5666c13c9c52130f076efb8b3aa45"}
Sep 17 09:33:55.350344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.350031    2558 scope.go:117] "RemoveContainer" containerID="91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645"
Sep 17 09:33:55.358864 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.358841    2558 scope.go:117] "RemoveContainer" containerID="91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645"
Sep 17 09:33:55.359125 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:33:55.359107    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645\": container with ID starting with 91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645 not found: ID does not exist" containerID="91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645"
Sep 17 09:33:55.359191 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.359134    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645"} err="failed to get container status \"91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645\": rpc error: code = NotFound desc = could not find container \"91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645\": container with ID starting with 91f10c35edf66d36e7ad291c8a1a6a535e55eff675c1d30fff11519355f70645 not found: ID does not exist"
Sep 17 09:33:55.380617 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.380586    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7685775585-9xbzq"]
Sep 17 09:33:55.392668 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.392641    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7685775585-9xbzq"]
Sep 17 09:33:55.459343 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:33:55.459313    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78df4ff9-4aa8-4070-90d6-b494a057f0f7" path="/var/lib/kubelet/pods/78df4ff9-4aa8-4070-90d6-b494a057f0f7/volumes"
Sep 17 09:34:55.301874 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:34:55.301846    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:34:55.308704 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:34:55.308680    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:34:55.311302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:34:55.311285    2558 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 09:35:00.129302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.129272    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"]
Sep 17 09:35:00.131505 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.129500    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78df4ff9-4aa8-4070-90d6-b494a057f0f7" containerName="console"
Sep 17 09:35:00.131505 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.129510    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="78df4ff9-4aa8-4070-90d6-b494a057f0f7" containerName="console"
Sep 17 09:35:00.131505 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.129558    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="78df4ff9-4aa8-4070-90d6-b494a057f0f7" containerName="console"
Sep 17 09:35:00.132332 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.132316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:00.135291 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.135268    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 17 09:35:00.136525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.136505    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 17 09:35:00.136635 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.136507    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-gcpvv\""
Sep 17 09:35:00.142592 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.142571    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"]
Sep 17 09:35:00.254992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.254954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4dll\" (UniqueName: \"kubernetes.io/projected/5763b283-954d-42e6-bd26-a2720e31188f-kube-api-access-m4dll\") pod \"feast-operator-controller-manager-b78cb886d-2xrv9\" (UID: \"5763b283-954d-42e6-bd26-a2720e31188f\") " pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:00.355817 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.355775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4dll\" (UniqueName: \"kubernetes.io/projected/5763b283-954d-42e6-bd26-a2720e31188f-kube-api-access-m4dll\") pod \"feast-operator-controller-manager-b78cb886d-2xrv9\" (UID: \"5763b283-954d-42e6-bd26-a2720e31188f\") " pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:00.367282 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.367253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4dll\" (UniqueName: \"kubernetes.io/projected/5763b283-954d-42e6-bd26-a2720e31188f-kube-api-access-m4dll\") pod \"feast-operator-controller-manager-b78cb886d-2xrv9\" (UID: \"5763b283-954d-42e6-bd26-a2720e31188f\") " pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:00.441532 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.441439    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:00.719513 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.719483    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"]
Sep 17 09:35:00.722750 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:35:00.722721    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5763b283_954d_42e6_bd26_a2720e31188f.slice/crio-2cfc1ddedc82364caba9a713dfa3b884555841647f96b8538eb0903d206669c9 WatchSource:0}: Error finding container 2cfc1ddedc82364caba9a713dfa3b884555841647f96b8538eb0903d206669c9: Status 404 returned error can't find the container with id 2cfc1ddedc82364caba9a713dfa3b884555841647f96b8538eb0903d206669c9
Sep 17 09:35:00.724668 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:00.724648    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 09:35:01.573646 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:01.573601    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9" event={"ID":"5763b283-954d-42e6-bd26-a2720e31188f","Type":"ContainerStarted","Data":"2cfc1ddedc82364caba9a713dfa3b884555841647f96b8538eb0903d206669c9"}
Sep 17 09:35:03.581593 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:03.581560    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9" event={"ID":"5763b283-954d-42e6-bd26-a2720e31188f","Type":"ContainerStarted","Data":"ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336"}
Sep 17 09:35:03.581950 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:03.581630    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:14.587874 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:14.587843    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:35:14.616595 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:14.616545    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9" podStartSLOduration=12.385298789 podStartE2EDuration="14.616527775s" totalImagesPullingTime="2.231228986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:35:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:35:03.608986809 +0000 UTC m=+308.675198596" watchObservedRunningTime="2026-09-17 09:35:14.616527775 +0000 UTC m=+319.682739541"
Sep 17 09:35:36.259500 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.259465    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"]
Sep 17 09:35:36.264498 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.264471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.267697 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.267672    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 09:35:36.267814 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.267701    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 09:35:36.267814 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.267752    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 17 09:35:36.267993 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.267958    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 09:35:36.268189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.268044    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pt5sm\""
Sep 17 09:35:36.268280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.268220    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 09:35:36.268335 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.268093    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 09:35:36.268400 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.268063    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 09:35:36.281862 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.281840    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"]
Sep 17 09:35:36.304798 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.304770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.304907 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.304823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.304907 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.304856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.304998 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.304913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.304998 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.304935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460bed39-947d-4175-8fc6-020889fff65c-feast-data\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.304998 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.304963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxqst\" (UniqueName: \"kubernetes.io/projected/460bed39-947d-4175-8fc6-020889fff65c-kube-api-access-xxqst\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405623 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.405594    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405750 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.405631    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460bed39-947d-4175-8fc6-020889fff65c-feast-data\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405750 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.405660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxqst\" (UniqueName: \"kubernetes.io/projected/460bed39-947d-4175-8fc6-020889fff65c-kube-api-access-xxqst\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405750 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.405688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405750 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.405723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405952 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.405751    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.405952 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.405865    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 09:35:36.405952 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.405920    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls podName:460bed39-947d-4175-8fc6-020889fff65c nodeName:}" failed. No retries permitted until 2026-09-17 09:35:36.905900268 +0000 UTC m=+341.972112025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls") pod "feast-simple-feast-setup-857b667fb9-8fzdg" (UID: "460bed39-947d-4175-8fc6-020889fff65c") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 09:35:36.406097 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.406008    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 09:35:36.406097 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.406074    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls podName:460bed39-947d-4175-8fc6-020889fff65c nodeName:}" failed. No retries permitted until 2026-09-17 09:35:36.906057592 +0000 UTC m=+341.972269351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls") pod "feast-simple-feast-setup-857b667fb9-8fzdg" (UID: "460bed39-947d-4175-8fc6-020889fff65c") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 09:35:36.406097 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.406074    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460bed39-947d-4175-8fc6-020889fff65c-feast-data\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.406269 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.406126    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 09:35:36.406269 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.406157    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls podName:460bed39-947d-4175-8fc6-020889fff65c nodeName:}" failed. No retries permitted until 2026-09-17 09:35:36.906147458 +0000 UTC m=+341.972359203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls") pod "feast-simple-feast-setup-857b667fb9-8fzdg" (UID: "460bed39-947d-4175-8fc6-020889fff65c") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 09:35:36.406269 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.406188    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 09:35:36.406269 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:35:36.406240    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls podName:460bed39-947d-4175-8fc6-020889fff65c nodeName:}" failed. No retries permitted until 2026-09-17 09:35:36.906225759 +0000 UTC m=+341.972437507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls") pod "feast-simple-feast-setup-857b667fb9-8fzdg" (UID: "460bed39-947d-4175-8fc6-020889fff65c") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 09:35:36.417811 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.417789    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxqst\" (UniqueName: \"kubernetes.io/projected/460bed39-947d-4175-8fc6-020889fff65c-kube-api-access-xxqst\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.910108 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.910072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.910108 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.910110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.910380 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.910153    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.910380 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.910196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.912678 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.912642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.912784 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.912644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.912784 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.912689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:36.912784 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:36.912689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-8fzdg\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:37.178054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:37.177971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:35:37.463317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:37.463294    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"]
Sep 17 09:35:37.465129 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:35:37.465097    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod460bed39_947d_4175_8fc6_020889fff65c.slice/crio-a72a067085acfb4903ec91dc3c125082f35998b55101deaa522f434ab29ac28b WatchSource:0}: Error finding container a72a067085acfb4903ec91dc3c125082f35998b55101deaa522f434ab29ac28b: Status 404 returned error can't find the container with id a72a067085acfb4903ec91dc3c125082f35998b55101deaa522f434ab29ac28b
Sep 17 09:35:37.697370 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:35:37.697335    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"a72a067085acfb4903ec91dc3c125082f35998b55101deaa522f434ab29ac28b"}
Sep 17 09:36:01.800865 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:01.800764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"}
Sep 17 09:36:06.820446 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:06.820410    2558 generic.go:356] "Generic (PLEG): container finished" podID="460bed39-947d-4175-8fc6-020889fff65c" containerID="42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b" exitCode=0
Sep 17 09:36:06.820860 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:06.820469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"}
Sep 17 09:36:07.825759 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:07.825728    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"}
Sep 17 09:36:12.844936 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:12.844852    2558 generic.go:356] "Generic (PLEG): container finished" podID="460bed39-947d-4175-8fc6-020889fff65c" containerID="188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c" exitCode=0
Sep 17 09:36:12.845422 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:12.844929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"}
Sep 17 09:36:12.850887 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:12.850869    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 17 09:36:13.854309 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:13.854266    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"}
Sep 17 09:36:13.854798 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:13.854345    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"}
Sep 17 09:36:13.854798 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:13.854367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"}
Sep 17 09:36:13.854798 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:13.854403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerStarted","Data":"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"}
Sep 17 09:36:13.884083 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:13.884009    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podStartSLOduration=13.839569632 podStartE2EDuration="37.883983304s" totalImagesPullingTime="24.044413672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:36:13.882781134 +0000 UTC m=+378.948992892" watchObservedRunningTime="2026-09-17 09:36:13.883983304 +0000 UTC m=+378.950195070"
Sep 17 09:36:16.178795 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.178716    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:16.178795 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.178781    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:16.178795 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.178802    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:16.179399 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.178914    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:16.180820 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.180749    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused"
Sep 17 09:36:16.180820 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.180777    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
Sep 17 09:36:16.181014 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.180855    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
Sep 17 09:36:16.181014 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:16.180944    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
Sep 17 09:36:17.178462 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:17.178423    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:17.178730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:17.178707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:17.178730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:17.178734    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:17.179211 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:17.178752    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:19.178614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:19.178560    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused"
Sep 17 09:36:19.179186 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:19.178608    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
Sep 17 09:36:19.179186 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:19.178560    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.18:6571: connect: connection refused"
Sep 17 09:36:19.179186 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:19.178746    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
Sep 17 09:36:22.180204 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.180145    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.180602 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.180372    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.180602 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.180535    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.181250 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.181226    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.181342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.181287    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.181342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.181317    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.185791 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.185774    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:22.899090 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:22.899063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:36:55.943971 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:36:55.943919    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c5fbf686-ndr6w"]
Sep 17 09:37:20.962181 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:20.962061    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69c5fbf686-ndr6w" podUID="5cd8a511-3140-41f7-a5ab-242c3bbc1704" containerName="console" containerID="cri-o://7e2f32c04f2d76c9b289e8b67f8d22196d2abcf46abc393086633d69fd156bb3" gracePeriod=15
Sep 17 09:37:21.094273 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.094240    2558 generic.go:356] "Generic (PLEG): container finished" podID="5cd8a511-3140-41f7-a5ab-242c3bbc1704" containerID="7e2f32c04f2d76c9b289e8b67f8d22196d2abcf46abc393086633d69fd156bb3" exitCode=0
Sep 17 09:37:21.094411 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.094277    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5fbf686-ndr6w" event={"ID":"5cd8a511-3140-41f7-a5ab-242c3bbc1704","Type":"ContainerDied","Data":"7e2f32c04f2d76c9b289e8b67f8d22196d2abcf46abc393086633d69fd156bb3"}
Sep 17 09:37:21.198461 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.198438    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:37:21.305408 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305379    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-oauth-serving-cert\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305430    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-trusted-ca-bundle\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305455    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-oauth-config\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305472    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-service-ca\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305497    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-config\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305514    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mqz4\" (UniqueName: \"kubernetes.io/projected/5cd8a511-3140-41f7-a5ab-242c3bbc1704-kube-api-access-7mqz4\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305534    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-serving-cert\") pod \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\" (UID: \"5cd8a511-3140-41f7-a5ab-242c3bbc1704\") "
Sep 17 09:37:21.305928 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305895    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:37:21.306055 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305931    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-config" (OuterVolumeSpecName: "console-config") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:37:21.306055 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.305950    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:37:21.306055 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.306001    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-service-ca" (OuterVolumeSpecName: "service-ca") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:37:21.307643 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.307615    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:37:21.307731 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.307652    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:37:21.307731 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.307663    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd8a511-3140-41f7-a5ab-242c3bbc1704-kube-api-access-7mqz4" (OuterVolumeSpecName: "kube-api-access-7mqz4") pod "5cd8a511-3140-41f7-a5ab-242c3bbc1704" (UID: "5cd8a511-3140-41f7-a5ab-242c3bbc1704"). InnerVolumeSpecName "kube-api-access-7mqz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:37:21.406685 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406659    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-oauth-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:21.406685 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406681    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-trusted-ca-bundle\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:21.406829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406690    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-oauth-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:21.406829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406700    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-service-ca\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:21.406829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406708    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-config\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:21.406829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406716    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mqz4\" (UniqueName: \"kubernetes.io/projected/5cd8a511-3140-41f7-a5ab-242c3bbc1704-kube-api-access-7mqz4\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:21.406829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:21.406724    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd8a511-3140-41f7-a5ab-242c3bbc1704-console-serving-cert\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:22.098616 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:22.098579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c5fbf686-ndr6w" event={"ID":"5cd8a511-3140-41f7-a5ab-242c3bbc1704","Type":"ContainerDied","Data":"d4f415025ef9b94e4bd5007fb5a2fcc0be02aa21f1938ae63d47a7787b203128"}
Sep 17 09:37:22.099029 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:22.098632    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c5fbf686-ndr6w"
Sep 17 09:37:22.099029 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:22.098680    2558 scope.go:117] "RemoveContainer" containerID="7e2f32c04f2d76c9b289e8b67f8d22196d2abcf46abc393086633d69fd156bb3"
Sep 17 09:37:22.117998 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:22.117973    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c5fbf686-ndr6w"]
Sep 17 09:37:22.121745 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:22.121722    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69c5fbf686-ndr6w"]
Sep 17 09:37:23.459779 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:23.459747    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cd8a511-3140-41f7-a5ab-242c3bbc1704" path="/var/lib/kubelet/pods/5cd8a511-3140-41f7-a5ab-242c3bbc1704/volumes"
Sep 17 09:37:24.525027 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:24.524990    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"]
Sep 17 09:37:24.525516 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:24.525322    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online" containerID="cri-o://538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c" gracePeriod=30
Sep 17 09:37:24.525516 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:24.525325    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui" containerID="cri-o://ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca" gracePeriod=30
Sep 17 09:37:24.525516 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:24.525332    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="offline" containerID="cri-o://123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8" gracePeriod=30
Sep 17 09:37:24.525516 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:24.525302    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="registry" containerID="cri-o://a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62" gracePeriod=30
Sep 17 09:37:25.144948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.144899    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"]
Sep 17 09:37:25.145214 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.145200    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd8a511-3140-41f7-a5ab-242c3bbc1704" containerName="console"
Sep 17 09:37:25.145214 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.145215    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd8a511-3140-41f7-a5ab-242c3bbc1704" containerName="console"
Sep 17 09:37:25.145349 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.145264    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cd8a511-3140-41f7-a5ab-242c3bbc1704" containerName="console"
Sep 17 09:37:25.149682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.149661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.155530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.155321    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-mpfnr\""
Sep 17 09:37:25.180996 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.180959    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"]
Sep 17 09:37:25.231418 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.231280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.231418 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.231329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qh6\" (UniqueName: \"kubernetes.io/projected/7338b06f-15b6-4d40-a8dd-596c664f13fe-kube-api-access-42qh6\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.231418 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.231370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.231682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.231447    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7338b06f-15b6-4d40-a8dd-596c664f13fe-feast-data\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.231682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.231582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.231682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.231678    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.332586 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.332557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.332716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.332608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qh6\" (UniqueName: \"kubernetes.io/projected/7338b06f-15b6-4d40-a8dd-596c664f13fe-kube-api-access-42qh6\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.332716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.332643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.332716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.332667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7338b06f-15b6-4d40-a8dd-596c664f13fe-feast-data\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.332873 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:25.332713    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 09:37:25.332873 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:25.332782    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls podName:7338b06f-15b6-4d40-a8dd-596c664f13fe nodeName:}" failed. No retries permitted until 2026-09-17 09:37:25.832762183 +0000 UTC m=+450.898973942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls") pod "feast-simple-feast-setup-857b667fb9-m45cj" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 09:37:25.332873 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:25.332787    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 09:37:25.332873 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.332719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.332873 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:25.332834    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls podName:7338b06f-15b6-4d40-a8dd-596c664f13fe nodeName:}" failed. No retries permitted until 2026-09-17 09:37:25.832818481 +0000 UTC m=+450.899030248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls") pod "feast-simple-feast-setup-857b667fb9-m45cj" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 09:37:25.332873 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.332870    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.333341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.333307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7338b06f-15b6-4d40-a8dd-596c664f13fe-feast-data\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.335391 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.335356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-ui-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.335593 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.335574    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-registry-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.342342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.342319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qh6\" (UniqueName: \"kubernetes.io/projected/7338b06f-15b6-4d40-a8dd-596c664f13fe-kube-api-access-42qh6\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.837437 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.837400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.837889 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.837459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.839708 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.839684    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:25.839858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:25.839833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls\") pod \"feast-simple-feast-setup-857b667fb9-m45cj\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") " pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:26.066716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:26.066678    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:26.120001 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:26.119947    2558 generic.go:356] "Generic (PLEG): container finished" podID="460bed39-947d-4175-8fc6-020889fff65c" containerID="ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca" exitCode=0
Sep 17 09:37:26.120001 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:26.119991    2558 generic.go:356] "Generic (PLEG): container finished" podID="460bed39-947d-4175-8fc6-020889fff65c" containerID="538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c" exitCode=0
Sep 17 09:37:26.120190 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:26.120022    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"}
Sep 17 09:37:26.120190 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:26.120079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"}
Sep 17 09:37:26.345622 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:26.345546    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"]
Sep 17 09:37:26.348180 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:37:26.348138    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7338b06f_15b6_4d40_a8dd_596c664f13fe.slice/crio-a371177669cb49171f97bf7f45e43337c2a604c822b924e062b7ac0dbe1b775b WatchSource:0}: Error finding container a371177669cb49171f97bf7f45e43337c2a604c822b924e062b7ac0dbe1b775b: Status 404 returned error can't find the container with id a371177669cb49171f97bf7f45e43337c2a604c822b924e062b7ac0dbe1b775b
Sep 17 09:37:27.126061 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:27.126025    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"704a3fdafd77be407a8d2be20c9b0f3c88723c17999af98adbf29adeca99c2b3"}
Sep 17 09:37:27.126461 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:27.126080    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"a371177669cb49171f97bf7f45e43337c2a604c822b924e062b7ac0dbe1b775b"}
Sep 17 09:37:31.146499 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:31.146463    2558 generic.go:356] "Generic (PLEG): container finished" podID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerID="704a3fdafd77be407a8d2be20c9b0f3c88723c17999af98adbf29adeca99c2b3" exitCode=0
Sep 17 09:37:31.146852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:31.146531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"704a3fdafd77be407a8d2be20c9b0f3c88723c17999af98adbf29adeca99c2b3"}
Sep 17 09:37:32.153812 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:32.153783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"b831bafffbd43c18a30f8071510d3e0dd9f7699d770e799cbc6aa4615ffbb692"}
Sep 17 09:37:32.181557 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:32.181517    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
Sep 17 09:37:32.896779 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:32.896740    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
Sep 17 09:37:37.179398 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:37.179319    2558 generic.go:356] "Generic (PLEG): container finished" podID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerID="b831bafffbd43c18a30f8071510d3e0dd9f7699d770e799cbc6aa4615ffbb692" exitCode=0
Sep 17 09:37:37.179398 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:37.179364    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"b831bafffbd43c18a30f8071510d3e0dd9f7699d770e799cbc6aa4615ffbb692"}
Sep 17 09:37:38.188553 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:38.188515    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"3c74b8bb9a7aed94809606c73f4c5d52ce4bcf93a9043cd6aac2eab4359ac20f"}
Sep 17 09:37:38.189034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:38.188578    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"426c4ebd8b0f9c315f2d9f0063e80841699d2de39c19085d8d8aa3517ad3a31e"}
Sep 17 09:37:38.189034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:38.188600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"2acd69160013f8f9c0d5aa3b041ed6cb14f3fce3de9d90116cc8234c0fb4f81f"}
Sep 17 09:37:38.189034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:38.188620    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerStarted","Data":"9d597ee551e1026f0499dd95e905d44dae40081fa87d1e49ef5c1905c0785a85"}
Sep 17 09:37:38.220098 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:38.220041    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podStartSLOduration=13.220020627 podStartE2EDuration="13.220020627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:37:38.218252702 +0000 UTC m=+463.284464478" watchObservedRunningTime="2026-09-17 09:37:38.220020627 +0000 UTC m=+463.286232400"
Sep 17 09:37:41.067863 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.067793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:41.067863 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.067867    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:41.068447 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.067887    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:41.068447 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.067904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:41.069947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.069909    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
Sep 17 09:37:41.070079 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.069937    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused"
Sep 17 09:37:41.070079 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.069950    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
Sep 17 09:37:41.070079 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:41.070030    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused"
Sep 17 09:37:42.182155 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:42.182100    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
Sep 17 09:37:42.897194 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:42.897111    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
Sep 17 09:37:44.067338 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:44.067293    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
Sep 17 09:37:44.067817 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:44.067293    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.19:6571: connect: connection refused"
Sep 17 09:37:44.067817 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:44.067311    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
Sep 17 09:37:44.067817 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:44.067473    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.19:8816: connect: connection refused"
Sep 17 09:37:46.067497 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:46.067465    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:46.067853 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:46.067532    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:46.067853 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:46.067546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:46.067853 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:46.067557    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.068097 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.068062    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.068598 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.068453    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.068598 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.068569    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.073262 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.073242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.230287 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.230258    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.230467 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.230331    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.230467 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.230458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:47.232916 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:47.232881    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:37:52.181848 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:52.181804    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused"
Sep 17 09:37:52.182327 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:52.181940    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:37:52.896456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:52.896412    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused"
Sep 17 09:37:52.896631 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:52.896544    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:37:55.169793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.169770    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:37:55.259337 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259305    2558 generic.go:356] "Generic (PLEG): container finished" podID="460bed39-947d-4175-8fc6-020889fff65c" containerID="123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8" exitCode=137
Sep 17 09:37:55.259337 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259329    2558 generic.go:356] "Generic (PLEG): container finished" podID="460bed39-947d-4175-8fc6-020889fff65c" containerID="a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62" exitCode=137
Sep 17 09:37:55.259572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259372    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"
Sep 17 09:37:55.259572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"}
Sep 17 09:37:55.259572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"}
Sep 17 09:37:55.259572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg" event={"ID":"460bed39-947d-4175-8fc6-020889fff65c","Type":"ContainerDied","Data":"a72a067085acfb4903ec91dc3c125082f35998b55101deaa522f434ab29ac28b"}
Sep 17 09:37:55.259572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.259519    2558 scope.go:117] "RemoveContainer" containerID="ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"
Sep 17 09:37:55.267218 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.267205    2558 scope.go:117] "RemoveContainer" containerID="123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"
Sep 17 09:37:55.269241 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269224    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls\") pod \"460bed39-947d-4175-8fc6-020889fff65c\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") "
Sep 17 09:37:55.269313 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269264    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls\") pod \"460bed39-947d-4175-8fc6-020889fff65c\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") "
Sep 17 09:37:55.269313 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269284    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460bed39-947d-4175-8fc6-020889fff65c-feast-data\") pod \"460bed39-947d-4175-8fc6-020889fff65c\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") "
Sep 17 09:37:55.269313 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269307    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxqst\" (UniqueName: \"kubernetes.io/projected/460bed39-947d-4175-8fc6-020889fff65c-kube-api-access-xxqst\") pod \"460bed39-947d-4175-8fc6-020889fff65c\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") "
Sep 17 09:37:55.269424 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269338    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls\") pod \"460bed39-947d-4175-8fc6-020889fff65c\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") "
Sep 17 09:37:55.269424 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269380    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls\") pod \"460bed39-947d-4175-8fc6-020889fff65c\" (UID: \"460bed39-947d-4175-8fc6-020889fff65c\") "
Sep 17 09:37:55.269828 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.269797    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460bed39-947d-4175-8fc6-020889fff65c-feast-data" (OuterVolumeSpecName: "feast-data") pod "460bed39-947d-4175-8fc6-020889fff65c" (UID: "460bed39-947d-4175-8fc6-020889fff65c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:37:55.271905 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.271878    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460bed39-947d-4175-8fc6-020889fff65c-kube-api-access-xxqst" (OuterVolumeSpecName: "kube-api-access-xxqst") pod "460bed39-947d-4175-8fc6-020889fff65c" (UID: "460bed39-947d-4175-8fc6-020889fff65c"). InnerVolumeSpecName "kube-api-access-xxqst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:37:55.272022 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.271880    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls" (OuterVolumeSpecName: "online-tls") pod "460bed39-947d-4175-8fc6-020889fff65c" (UID: "460bed39-947d-4175-8fc6-020889fff65c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:37:55.272022 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.271910    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "460bed39-947d-4175-8fc6-020889fff65c" (UID: "460bed39-947d-4175-8fc6-020889fff65c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:37:55.272022 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.271938    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "460bed39-947d-4175-8fc6-020889fff65c" (UID: "460bed39-947d-4175-8fc6-020889fff65c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:37:55.272203 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.272067    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "460bed39-947d-4175-8fc6-020889fff65c" (UID: "460bed39-947d-4175-8fc6-020889fff65c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:37:55.275087 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.275069    2558 scope.go:117] "RemoveContainer" containerID="538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"
Sep 17 09:37:55.282199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.282182    2558 scope.go:117] "RemoveContainer" containerID="a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"
Sep 17 09:37:55.288866 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.288851    2558 scope.go:117] "RemoveContainer" containerID="188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"
Sep 17 09:37:55.295141 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.295124    2558 scope.go:117] "RemoveContainer" containerID="42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"
Sep 17 09:37:55.301530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.301511    2558 scope.go:117] "RemoveContainer" containerID="ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"
Sep 17 09:37:55.301863 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:55.301828    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca\": container with ID starting with ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca not found: ID does not exist" containerID="ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"
Sep 17 09:37:55.301933 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.301865    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"} err="failed to get container status \"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca\": rpc error: code = NotFound desc = could not find container \"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca\": container with ID starting with ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca not found: ID does not exist"
Sep 17 09:37:55.301933 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.301889    2558 scope.go:117] "RemoveContainer" containerID="123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"
Sep 17 09:37:55.302132 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:55.302119    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8\": container with ID starting with 123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8 not found: ID does not exist" containerID="123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"
Sep 17 09:37:55.302206 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302135    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"} err="failed to get container status \"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8\": rpc error: code = NotFound desc = could not find container \"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8\": container with ID starting with 123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8 not found: ID does not exist"
Sep 17 09:37:55.302206 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302147    2558 scope.go:117] "RemoveContainer" containerID="538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"
Sep 17 09:37:55.302418 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:55.302404    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c\": container with ID starting with 538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c not found: ID does not exist" containerID="538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"
Sep 17 09:37:55.302453 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302423    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"} err="failed to get container status \"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c\": rpc error: code = NotFound desc = could not find container \"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c\": container with ID starting with 538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c not found: ID does not exist"
Sep 17 09:37:55.302453 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302436    2558 scope.go:117] "RemoveContainer" containerID="a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"
Sep 17 09:37:55.302640 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:55.302627    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62\": container with ID starting with a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62 not found: ID does not exist" containerID="a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"
Sep 17 09:37:55.302685 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302642    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"} err="failed to get container status \"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62\": rpc error: code = NotFound desc = could not find container \"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62\": container with ID starting with a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62 not found: ID does not exist"
Sep 17 09:37:55.302685 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302652    2558 scope.go:117] "RemoveContainer" containerID="188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"
Sep 17 09:37:55.302859 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:55.302843    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c\": container with ID starting with 188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c not found: ID does not exist" containerID="188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"
Sep 17 09:37:55.302904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302866    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"} err="failed to get container status \"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c\": rpc error: code = NotFound desc = could not find container \"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c\": container with ID starting with 188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c not found: ID does not exist"
Sep 17 09:37:55.302904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.302881    2558 scope.go:117] "RemoveContainer" containerID="42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"
Sep 17 09:37:55.303101 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:37:55.303087    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b\": container with ID starting with 42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b not found: ID does not exist" containerID="42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"
Sep 17 09:37:55.303152 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"} err="failed to get container status \"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b\": rpc error: code = NotFound desc = could not find container \"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b\": container with ID starting with 42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b not found: ID does not exist"
Sep 17 09:37:55.303152 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303115    2558 scope.go:117] "RemoveContainer" containerID="ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"
Sep 17 09:37:55.303338 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303320    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca"} err="failed to get container status \"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca\": rpc error: code = NotFound desc = could not find container \"ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca\": container with ID starting with ac41b7ed23d0f24a31d292e8d433b191b16982814d2169bfe3d0ca1168cefeca not found: ID does not exist"
Sep 17 09:37:55.303376 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303339    2558 scope.go:117] "RemoveContainer" containerID="123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"
Sep 17 09:37:55.303590 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303572    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8"} err="failed to get container status \"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8\": rpc error: code = NotFound desc = could not find container \"123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8\": container with ID starting with 123904eddd77055096c37352d4b55aac980c1c8da1ffb0cb778bbba2f37782c8 not found: ID does not exist"
Sep 17 09:37:55.303635 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303590    2558 scope.go:117] "RemoveContainer" containerID="538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"
Sep 17 09:37:55.303771 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303756    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c"} err="failed to get container status \"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c\": rpc error: code = NotFound desc = could not find container \"538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c\": container with ID starting with 538fcf2f4dd4d439bd99728aa2ae9f13d23ba04e1fdc77da85f38214e9994c6c not found: ID does not exist"
Sep 17 09:37:55.303812 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303771    2558 scope.go:117] "RemoveContainer" containerID="a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"
Sep 17 09:37:55.304006 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.303988    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62"} err="failed to get container status \"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62\": rpc error: code = NotFound desc = could not find container \"a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62\": container with ID starting with a0fb2f3feddf4e60de8ce8771487a4756ffb0cf1a524be88ea478fe82515be62 not found: ID does not exist"
Sep 17 09:37:55.304051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.304006    2558 scope.go:117] "RemoveContainer" containerID="188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"
Sep 17 09:37:55.304226 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.304209    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c"} err="failed to get container status \"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c\": rpc error: code = NotFound desc = could not find container \"188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c\": container with ID starting with 188ac6295b34a2966fc156c3b2bcb9c679776deec9f51ce0e5a0a617d1b0e83c not found: ID does not exist"
Sep 17 09:37:55.304275 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.304226    2558 scope.go:117] "RemoveContainer" containerID="42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"
Sep 17 09:37:55.304441 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.304424    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b"} err="failed to get container status \"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b\": rpc error: code = NotFound desc = could not find container \"42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b\": container with ID starting with 42dcce080374acfbc7f4fb959f4dfe64da797a702f55e605beb77a77a5bb5f9b not found: ID does not exist"
Sep 17 09:37:55.370085 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.370058    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:55.370189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.370097    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:55.370189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.370106    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/460bed39-947d-4175-8fc6-020889fff65c-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:55.370189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.370115    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxqst\" (UniqueName: \"kubernetes.io/projected/460bed39-947d-4175-8fc6-020889fff65c-kube-api-access-xxqst\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:55.370189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.370123    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:55.370189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.370131    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/460bed39-947d-4175-8fc6-020889fff65c-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:37:55.577604 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.577541    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"]
Sep 17 09:37:55.583406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:55.583384    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-8fzdg"]
Sep 17 09:37:57.459801 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:37:57.459766    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460bed39-947d-4175-8fc6-020889fff65c" path="/var/lib/kubelet/pods/460bed39-947d-4175-8fc6-020889fff65c/volumes"
Sep 17 09:38:49.970581 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970542    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"]
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970791    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970802    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970813    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="feast-init"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970818    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="feast-init"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970827    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="registry"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970832    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="registry"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970840    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="offline"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="offline"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970856    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="feast-apply"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970861    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="feast-apply"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970867    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970872    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970909    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="ui"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970916    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="offline"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970924    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="online"
Sep 17 09:38:49.971143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.970929    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="460bed39-947d-4175-8fc6-020889fff65c" containerName="registry"
Sep 17 09:38:49.973896 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.973878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:49.979387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.979353    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 09:38:49.979667 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.979641    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 17 09:38:49.979777 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.979691    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 09:38:49.980504 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.980033    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 09:38:49.980504 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.980091    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 09:38:49.980504 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.980351    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 09:38:49.980649 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.980541    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 09:38:49.981075 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.981061    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-w8c85\""
Sep 17 09:38:49.993249 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:49.993230    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"]
Sep 17 09:38:50.005536 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.005516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.005634 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.005543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-offline-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.005634 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.005562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-feast-data\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.005634 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.005626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-ui-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.005788 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.005662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-registry-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.005788 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.005686    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rs7s\" (UniqueName: \"kubernetes.io/projected/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-kube-api-access-6rs7s\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106195 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106195 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-offline-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-feast-data\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-ui-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-registry-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rs7s\" (UniqueName: \"kubernetes.io/projected/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-kube-api-access-6rs7s\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106387 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:38:50.106380    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 17 09:38:50.106638 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:38:50.106468    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls podName:c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c nodeName:}" failed. No retries permitted until 2026-09-17 09:38:50.606449463 +0000 UTC m=+535.672661229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls") pod "feast-simple-feast-remote-setup-85d6ddc458-5lpzd" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c") : secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 17 09:38:50.106638 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-feast-data\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.106973 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.106952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-registry-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.108739 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.108716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-offline-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.108870 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.108747    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-ui-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.121608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.121584    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rs7s\" (UniqueName: \"kubernetes.io/projected/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-kube-api-access-6rs7s\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.610005 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.609969    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.612260 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.612242    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls\") pod \"feast-simple-feast-remote-setup-85d6ddc458-5lpzd\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:50.882502 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:50.882425    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:38:51.162086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:51.162059    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"]
Sep 17 09:38:51.162845 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:38:51.162819    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3917f60_fef8_40ca_b3cc_ff6cc7cfc02c.slice/crio-8c374a612a47d4f999d51a5a99ada144fcd4271c8bbdd1b8bf1fdae24927373e WatchSource:0}: Error finding container 8c374a612a47d4f999d51a5a99ada144fcd4271c8bbdd1b8bf1fdae24927373e: Status 404 returned error can't find the container with id 8c374a612a47d4f999d51a5a99ada144fcd4271c8bbdd1b8bf1fdae24927373e
Sep 17 09:38:51.452135 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:51.451633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerStarted","Data":"012bfedfe9c1ef88cd4b3b349f5f47bce2973260f6513d360e96f6a37e6c510f"}
Sep 17 09:38:51.452135 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:51.451686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerStarted","Data":"8c374a612a47d4f999d51a5a99ada144fcd4271c8bbdd1b8bf1fdae24927373e"}
Sep 17 09:38:56.470492 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:56.470460    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerID="012bfedfe9c1ef88cd4b3b349f5f47bce2973260f6513d360e96f6a37e6c510f" exitCode=0
Sep 17 09:38:56.470850 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:56.470530    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerDied","Data":"012bfedfe9c1ef88cd4b3b349f5f47bce2973260f6513d360e96f6a37e6c510f"}
Sep 17 09:38:57.475878 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:38:57.475844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerStarted","Data":"d9bc32c40e47f8d9d1d1f281b0503421494bfd52097ec28abf7dbab9ed602dd2"}
Sep 17 09:39:21.560768 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:21.560735    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerID="d9bc32c40e47f8d9d1d1f281b0503421494bfd52097ec28abf7dbab9ed602dd2" exitCode=0
Sep 17 09:39:21.561222 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:21.560800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerDied","Data":"d9bc32c40e47f8d9d1d1f281b0503421494bfd52097ec28abf7dbab9ed602dd2"}
Sep 17 09:39:21.565145 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:21.565125    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 17 09:39:22.569367 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:22.569329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerStarted","Data":"5f7d28b277b5a60d88a2c6268ea42241900b624c1c7e3d949d318fd2ce523c30"}
Sep 17 09:39:22.569852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:22.569380    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerStarted","Data":"03557b19e0023826f80311de12a61fcca10839883a6b1bdb0fe93721cfb5c60f"}
Sep 17 09:39:22.569852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:22.569392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerStarted","Data":"53a93fab0c733a15d9dad109b7fda9446576b5622826ec246159d2431bc16ff5"}
Sep 17 09:39:22.602024 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:22.601962    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podStartSLOduration=33.601940946 podStartE2EDuration="33.601940946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:39:22.599581794 +0000 UTC m=+567.665793562" watchObservedRunningTime="2026-09-17 09:39:22.601940946 +0000 UTC m=+567.668152711"
Sep 17 09:39:23.883220 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:23.883184    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:23.883683 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:23.883257    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:23.883683 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:23.883278    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:23.885157 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:23.885123    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
Sep 17 09:39:23.885277 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:23.885146    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
Sep 17 09:39:23.885277 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:23.885151    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused"
Sep 17 09:39:26.883702 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:26.883658    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused"
Sep 17 09:39:26.884280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:26.883702    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
Sep 17 09:39:26.884280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:26.883658    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
Sep 17 09:39:29.884008 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.883978    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:29.884488 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.884091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:29.884488 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.884474    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:29.884599 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.884509    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:29.884660 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.884642    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:29.884918 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.884900    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:29.905663 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:29.905643    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:30.603939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:30.603898    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:30.624475 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:30.624447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:39:55.326837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:55.326810    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:39:55.330356 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:39:55.330333    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:40:32.318191 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.318080    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"]
Sep 17 09:40:32.320680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.318365    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online" containerID="cri-o://53a93fab0c733a15d9dad109b7fda9446576b5622826ec246159d2431bc16ff5" gracePeriod=30
Sep 17 09:40:32.320680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.318428    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="offline" containerID="cri-o://03557b19e0023826f80311de12a61fcca10839883a6b1bdb0fe93721cfb5c60f" gracePeriod=30
Sep 17 09:40:32.320680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.318426    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui" containerID="cri-o://5f7d28b277b5a60d88a2c6268ea42241900b624c1c7e3d949d318fd2ce523c30" gracePeriod=30
Sep 17 09:40:32.456296 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.456265    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"]
Sep 17 09:40:32.456518 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.456493    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="registry" containerID="cri-o://9d597ee551e1026f0499dd95e905d44dae40081fa87d1e49ef5c1905c0785a85" gracePeriod=30
Sep 17 09:40:32.456593 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.456538    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui" containerID="cri-o://3c74b8bb9a7aed94809606c73f4c5d52ce4bcf93a9043cd6aac2eab4359ac20f" gracePeriod=30
Sep 17 09:40:32.456638 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.456533    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="offline" containerID="cri-o://426c4ebd8b0f9c315f2d9f0063e80841699d2de39c19085d8d8aa3517ad3a31e" gracePeriod=30
Sep 17 09:40:32.456730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:32.456538    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online" containerID="cri-o://2acd69160013f8f9c0d5aa3b041ed6cb14f3fce3de9d90116cc8234c0fb4f81f" gracePeriod=30
Sep 17 09:40:33.824509 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.824471    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerID="5f7d28b277b5a60d88a2c6268ea42241900b624c1c7e3d949d318fd2ce523c30" exitCode=0
Sep 17 09:40:33.824509 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.824502    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerID="53a93fab0c733a15d9dad109b7fda9446576b5622826ec246159d2431bc16ff5" exitCode=0
Sep 17 09:40:33.824952 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.824547    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerDied","Data":"5f7d28b277b5a60d88a2c6268ea42241900b624c1c7e3d949d318fd2ce523c30"}
Sep 17 09:40:33.824952 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.824590    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerDied","Data":"53a93fab0c733a15d9dad109b7fda9446576b5622826ec246159d2431bc16ff5"}
Sep 17 09:40:33.827280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.827260    2558 generic.go:356] "Generic (PLEG): container finished" podID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerID="3c74b8bb9a7aed94809606c73f4c5d52ce4bcf93a9043cd6aac2eab4359ac20f" exitCode=0
Sep 17 09:40:33.827280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.827276    2558 generic.go:356] "Generic (PLEG): container finished" podID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerID="2acd69160013f8f9c0d5aa3b041ed6cb14f3fce3de9d90116cc8234c0fb4f81f" exitCode=0
Sep 17 09:40:33.827416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.827328    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"3c74b8bb9a7aed94809606c73f4c5d52ce4bcf93a9043cd6aac2eab4359ac20f"}
Sep 17 09:40:33.827416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:33.827362    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"2acd69160013f8f9c0d5aa3b041ed6cb14f3fce3de9d90116cc8234c0fb4f81f"}
Sep 17 09:40:37.229950 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:37.229902    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
Sep 17 09:40:37.230409 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:37.229956    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
Sep 17 09:40:39.885535 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:39.885482    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
Sep 17 09:40:40.605064 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:40.605024    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
Sep 17 09:40:47.230080 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:47.230032    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
Sep 17 09:40:47.230080 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:47.230063    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
Sep 17 09:40:49.885234 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:49.885194    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
Sep 17 09:40:50.604373 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:50.604333    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
Sep 17 09:40:57.229983 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:57.229921    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.19:8443: connect: connection refused"
Sep 17 09:40:57.229983 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:57.229959    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.19:6567/health\": dial tcp 10.132.0.19:6567: connect: connection refused"
Sep 17 09:40:57.230550 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:57.230084    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:40:57.230550 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:57.230197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:40:59.885392 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:59.885338    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
Sep 17 09:40:59.885795 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:40:59.885476    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:41:00.604548 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:00.604503    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
Sep 17 09:41:00.604721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:00.604656    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:41:02.931947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.931912    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerID="03557b19e0023826f80311de12a61fcca10839883a6b1bdb0fe93721cfb5c60f" exitCode=137
Sep 17 09:41:02.932394 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.931982    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerDied","Data":"03557b19e0023826f80311de12a61fcca10839883a6b1bdb0fe93721cfb5c60f"}
Sep 17 09:41:02.935338 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.935313    2558 generic.go:356] "Generic (PLEG): container finished" podID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerID="426c4ebd8b0f9c315f2d9f0063e80841699d2de39c19085d8d8aa3517ad3a31e" exitCode=137
Sep 17 09:41:02.935338 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.935339    2558 generic.go:356] "Generic (PLEG): container finished" podID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerID="9d597ee551e1026f0499dd95e905d44dae40081fa87d1e49ef5c1905c0785a85" exitCode=137
Sep 17 09:41:02.935516 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.935392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"426c4ebd8b0f9c315f2d9f0063e80841699d2de39c19085d8d8aa3517ad3a31e"}
Sep 17 09:41:02.935516 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.935435    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"9d597ee551e1026f0499dd95e905d44dae40081fa87d1e49ef5c1905c0785a85"}
Sep 17 09:41:02.960578 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:02.960555    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:41:03.087235 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-registry-tls\") pod \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") "
Sep 17 09:41:03.087381 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087251    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-feast-data\") pod \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") "
Sep 17 09:41:03.087381 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rs7s\" (UniqueName: \"kubernetes.io/projected/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-kube-api-access-6rs7s\") pod \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") "
Sep 17 09:41:03.087381 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-offline-tls\") pod \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") "
Sep 17 09:41:03.087381 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087347    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls\") pod \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") "
Sep 17 09:41:03.087381 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087381    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-ui-tls\") pod \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\" (UID: \"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c\") "
Sep 17 09:41:03.087644 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087587    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:41:03.087843 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.087806    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-feast-data" (OuterVolumeSpecName: "feast-data") pod "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:41:03.089681 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.089658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls" (OuterVolumeSpecName: "online-tls") pod "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.089780 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.089715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.089821 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.089780    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.089948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.089928    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-kube-api-access-6rs7s" (OuterVolumeSpecName: "kube-api-access-6rs7s") pod "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" (UID: "c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c"). InnerVolumeSpecName "kube-api-access-6rs7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:41:03.091793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.091778    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:41:03.188289 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188253    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls\") pod \"7338b06f-15b6-4d40-a8dd-596c664f13fe\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") "
Sep 17 09:41:03.188289 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188296    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls\") pod \"7338b06f-15b6-4d40-a8dd-596c664f13fe\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") "
Sep 17 09:41:03.188527 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188339    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7338b06f-15b6-4d40-a8dd-596c664f13fe-feast-data\") pod \"7338b06f-15b6-4d40-a8dd-596c664f13fe\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") "
Sep 17 09:41:03.188527 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188355    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-registry-tls\") pod \"7338b06f-15b6-4d40-a8dd-596c664f13fe\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") "
Sep 17 09:41:03.188527 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188375    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42qh6\" (UniqueName: \"kubernetes.io/projected/7338b06f-15b6-4d40-a8dd-596c664f13fe-kube-api-access-42qh6\") pod \"7338b06f-15b6-4d40-a8dd-596c664f13fe\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") "
Sep 17 09:41:03.188527 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-ui-tls\") pod \"7338b06f-15b6-4d40-a8dd-596c664f13fe\" (UID: \"7338b06f-15b6-4d40-a8dd-596c664f13fe\") "
Sep 17 09:41:03.188737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188563    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.188737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188581    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rs7s\" (UniqueName: \"kubernetes.io/projected/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-kube-api-access-6rs7s\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.188737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188596    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.188737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188608    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.188737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188620    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.188737 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188633    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.188979 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.188951    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7338b06f-15b6-4d40-a8dd-596c664f13fe-feast-data" (OuterVolumeSpecName: "feast-data") pod "7338b06f-15b6-4d40-a8dd-596c664f13fe" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:41:03.190680 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.190652    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls" (OuterVolumeSpecName: "online-tls") pod "7338b06f-15b6-4d40-a8dd-596c664f13fe" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.191051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.191021    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7338b06f-15b6-4d40-a8dd-596c664f13fe" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.191143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.191048    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7338b06f-15b6-4d40-a8dd-596c664f13fe" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.191143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.191031    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7338b06f-15b6-4d40-a8dd-596c664f13fe" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:41:03.191143 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.191066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7338b06f-15b6-4d40-a8dd-596c664f13fe-kube-api-access-42qh6" (OuterVolumeSpecName: "kube-api-access-42qh6") pod "7338b06f-15b6-4d40-a8dd-596c664f13fe" (UID: "7338b06f-15b6-4d40-a8dd-596c664f13fe"). InnerVolumeSpecName "kube-api-access-42qh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:41:03.289948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.289895    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.289948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.289942    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.289948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.289951    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7338b06f-15b6-4d40-a8dd-596c664f13fe-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.289948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.289959    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.289948 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.289968    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42qh6\" (UniqueName: \"kubernetes.io/projected/7338b06f-15b6-4d40-a8dd-596c664f13fe-kube-api-access-42qh6\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.290289 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.289979    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7338b06f-15b6-4d40-a8dd-596c664f13fe-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:41:03.941463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.941381    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"
Sep 17 09:41:03.941463 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.941377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd" event={"ID":"c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c","Type":"ContainerDied","Data":"8c374a612a47d4f999d51a5a99ada144fcd4271c8bbdd1b8bf1fdae24927373e"}
Sep 17 09:41:03.942098 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.941507    2558 scope.go:117] "RemoveContainer" containerID="5f7d28b277b5a60d88a2c6268ea42241900b624c1c7e3d949d318fd2ce523c30"
Sep 17 09:41:03.944658 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.944638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj" event={"ID":"7338b06f-15b6-4d40-a8dd-596c664f13fe","Type":"ContainerDied","Data":"a371177669cb49171f97bf7f45e43337c2a604c822b924e062b7ac0dbe1b775b"}
Sep 17 09:41:03.944776 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.944642    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"
Sep 17 09:41:03.950357 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.950342    2558 scope.go:117] "RemoveContainer" containerID="03557b19e0023826f80311de12a61fcca10839883a6b1bdb0fe93721cfb5c60f"
Sep 17 09:41:03.957911 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.957892    2558 scope.go:117] "RemoveContainer" containerID="53a93fab0c733a15d9dad109b7fda9446576b5622826ec246159d2431bc16ff5"
Sep 17 09:41:03.964631 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.964609    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"]
Sep 17 09:41:03.966111 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.966081    2558 scope.go:117] "RemoveContainer" containerID="d9bc32c40e47f8d9d1d1f281b0503421494bfd52097ec28abf7dbab9ed602dd2"
Sep 17 09:41:03.968265 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.968245    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-85d6ddc458-5lpzd"]
Sep 17 09:41:03.973086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.973071    2558 scope.go:117] "RemoveContainer" containerID="012bfedfe9c1ef88cd4b3b349f5f47bce2973260f6513d360e96f6a37e6c510f"
Sep 17 09:41:03.980026 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.980005    2558 scope.go:117] "RemoveContainer" containerID="3c74b8bb9a7aed94809606c73f4c5d52ce4bcf93a9043cd6aac2eab4359ac20f"
Sep 17 09:41:03.981535 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.981517    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"]
Sep 17 09:41:03.986378 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.986359    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-857b667fb9-m45cj"]
Sep 17 09:41:03.987268 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.987254    2558 scope.go:117] "RemoveContainer" containerID="426c4ebd8b0f9c315f2d9f0063e80841699d2de39c19085d8d8aa3517ad3a31e"
Sep 17 09:41:03.993857 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:03.993841    2558 scope.go:117] "RemoveContainer" containerID="2acd69160013f8f9c0d5aa3b041ed6cb14f3fce3de9d90116cc8234c0fb4f81f"
Sep 17 09:41:04.000478 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:04.000462    2558 scope.go:117] "RemoveContainer" containerID="9d597ee551e1026f0499dd95e905d44dae40081fa87d1e49ef5c1905c0785a85"
Sep 17 09:41:04.007223 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:04.007204    2558 scope.go:117] "RemoveContainer" containerID="b831bafffbd43c18a30f8071510d3e0dd9f7699d770e799cbc6aa4615ffbb692"
Sep 17 09:41:04.013691 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:04.013676    2558 scope.go:117] "RemoveContainer" containerID="704a3fdafd77be407a8d2be20c9b0f3c88723c17999af98adbf29adeca99c2b3"
Sep 17 09:41:05.458967 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:05.458937    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" path="/var/lib/kubelet/pods/7338b06f-15b6-4d40-a8dd-596c664f13fe/volumes"
Sep 17 09:41:05.459566 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:05.459550    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" path="/var/lib/kubelet/pods/c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c/volumes"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.390909    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-pw8s6"]
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391438    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391459    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391487    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391495    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391512    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="offline"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391520    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="offline"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391531    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="offline"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391539    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="offline"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391555    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="feast-init"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391563    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="feast-init"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391576    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="registry"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391584    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="registry"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391596    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391604    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391625    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="feast-apply"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391633    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="feast-apply"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391651    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="feast-init"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391660    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="feast-init"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391670    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="feast-apply"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391679    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="feast-apply"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391694    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391702    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391806    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="ui"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391816    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="online"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391833    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="online"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391841    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3917f60-fef8-40ca-b3cc-ff6cc7cfc02c" containerName="offline"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391849    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="registry"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391862    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="offline"
Sep 17 09:41:15.392904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.391870    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7338b06f-15b6-4d40-a8dd-596c664f13fe" containerName="ui"
Sep 17 09:41:15.397024 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.396993    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.401270 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.401249    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 17 09:41:15.401742 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.401727    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-5l8r6\""
Sep 17 09:41:15.401796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.401778    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 09:41:15.401878 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.401856    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 09:41:15.405419 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.405398    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-pw8s6"]
Sep 17 09:41:15.471742 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.471704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8d25aff0-35ce-4088-9e1b-30cc3be4490b-postgresdata\") pod \"postgres-864846d4f5-pw8s6\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") " pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.471742 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.471743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmjk\" (UniqueName: \"kubernetes.io/projected/8d25aff0-35ce-4088-9e1b-30cc3be4490b-kube-api-access-ggmjk\") pod \"postgres-864846d4f5-pw8s6\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") " pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.572987 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.572957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8d25aff0-35ce-4088-9e1b-30cc3be4490b-postgresdata\") pod \"postgres-864846d4f5-pw8s6\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") " pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.572987 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.572990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmjk\" (UniqueName: \"kubernetes.io/projected/8d25aff0-35ce-4088-9e1b-30cc3be4490b-kube-api-access-ggmjk\") pod \"postgres-864846d4f5-pw8s6\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") " pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.573354 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.573332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8d25aff0-35ce-4088-9e1b-30cc3be4490b-postgresdata\") pod \"postgres-864846d4f5-pw8s6\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") " pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.586530 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.586503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmjk\" (UniqueName: \"kubernetes.io/projected/8d25aff0-35ce-4088-9e1b-30cc3be4490b-kube-api-access-ggmjk\") pod \"postgres-864846d4f5-pw8s6\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") " pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.706470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.706388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:41:15.992641 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.992609    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-pw8s6"]
Sep 17 09:41:15.997650 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:41:15.997622    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d25aff0_35ce_4088_9e1b_30cc3be4490b.slice/crio-0090a6cac8b63787c891e0212d2f29f3dc49e9be7354b618390c95eb5e439c85 WatchSource:0}: Error finding container 0090a6cac8b63787c891e0212d2f29f3dc49e9be7354b618390c95eb5e439c85: Status 404 returned error can't find the container with id 0090a6cac8b63787c891e0212d2f29f3dc49e9be7354b618390c95eb5e439c85
Sep 17 09:41:15.999496 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:15.999473    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 09:41:16.991715 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:16.991679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-pw8s6" event={"ID":"8d25aff0-35ce-4088-9e1b-30cc3be4490b","Type":"ContainerStarted","Data":"0090a6cac8b63787c891e0212d2f29f3dc49e9be7354b618390c95eb5e439c85"}
Sep 17 09:41:22.011869 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:22.011826    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-pw8s6" event={"ID":"8d25aff0-35ce-4088-9e1b-30cc3be4490b","Type":"ContainerStarted","Data":"64a4656903f26da6ec79ac6c2c909f247cb362886b7c78aca88a6631a9e7f332"}
Sep 17 09:41:22.032694 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:22.032642    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-pw8s6" podStartSLOduration=1.880501755 podStartE2EDuration="7.032626656s" totalImagesPullingTime="5.152124901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:41:22.031034173 +0000 UTC m=+687.097245955" watchObservedRunningTime="2026-09-17 09:41:22.032626656 +0000 UTC m=+687.098838421"
Sep 17 09:41:26.382457 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.382419    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"]
Sep 17 09:41:26.393198 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.393150    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.396116 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.396092    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 17 09:41:26.396262 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.396130    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 17 09:41:26.396262 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.396178    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-64wh2\""
Sep 17 09:41:26.396364 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.396325    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 17 09:41:26.396476 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.396453    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 17 09:41:26.406783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.406756    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"]
Sep 17 09:41:26.557015 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.556976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.557015 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.557020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhjzk\" (UniqueName: \"kubernetes.io/projected/7f8dd97c-2504-4362-a630-79e200cf1b61-kube-api-access-nhjzk\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.557286 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.557119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-registry-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.557286 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.557150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-offline-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.557286 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.557190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8dd97c-2504-4362-a630-79e200cf1b61-feast-data\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.657924 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.657838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.657924 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.657881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjzk\" (UniqueName: \"kubernetes.io/projected/7f8dd97c-2504-4362-a630-79e200cf1b61-kube-api-access-nhjzk\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.658128 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.657932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-registry-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.658128 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.657949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-offline-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.658128 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.657966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8dd97c-2504-4362-a630-79e200cf1b61-feast-data\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.658128 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:41:26.658019    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 17 09:41:26.658128 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:41:26.658093    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls podName:7f8dd97c-2504-4362-a630-79e200cf1b61 nodeName:}" failed. No retries permitted until 2026-09-17 09:41:27.158072116 +0000 UTC m=+692.224283866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls") pod "feast-credit-scoring-f865fbccf-2z27j" (UID: "7f8dd97c-2504-4362-a630-79e200cf1b61") : secret "feast-credit-scoring-online-tls" not found
Sep 17 09:41:26.658513 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.658492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8dd97c-2504-4362-a630-79e200cf1b61-feast-data\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.660484 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.660461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-offline-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.660577 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.660516    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-registry-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:26.670725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:26.670701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhjzk\" (UniqueName: \"kubernetes.io/projected/7f8dd97c-2504-4362-a630-79e200cf1b61-kube-api-access-nhjzk\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:27.163045 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:27.163004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:27.165461 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:27.165437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls\") pod \"feast-credit-scoring-f865fbccf-2z27j\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") " pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:27.303135 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:27.303087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:27.585334 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:27.585306    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"]
Sep 17 09:41:27.586641 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:41:27.586616    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8dd97c_2504_4362_a630_79e200cf1b61.slice/crio-bcd4e7b08b40230cf2f6f8905d580a1a8b9fe58ca3ce028018c9221c083f5d9f WatchSource:0}: Error finding container bcd4e7b08b40230cf2f6f8905d580a1a8b9fe58ca3ce028018c9221c083f5d9f: Status 404 returned error can't find the container with id bcd4e7b08b40230cf2f6f8905d580a1a8b9fe58ca3ce028018c9221c083f5d9f
Sep 17 09:41:28.034829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:28.034793    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerStarted","Data":"4add4d8f50e84feded4a6d159bad089f77426154d80d56b02c84b0c6fdd31c3b"}
Sep 17 09:41:28.035030 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:28.034858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerStarted","Data":"bcd4e7b08b40230cf2f6f8905d580a1a8b9fe58ca3ce028018c9221c083f5d9f"}
Sep 17 09:41:29.039363 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:29.039332    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerID="4add4d8f50e84feded4a6d159bad089f77426154d80d56b02c84b0c6fdd31c3b" exitCode=0
Sep 17 09:41:29.039363 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:29.039367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerDied","Data":"4add4d8f50e84feded4a6d159bad089f77426154d80d56b02c84b0c6fdd31c3b"}
Sep 17 09:41:30.044436 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:30.044391    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerStarted","Data":"0f648e91842638024f77aacc8e7e01dd2e775f2c2a5d22872d735446fb839ea8"}
Sep 17 09:41:36.068914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:36.068830    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerID="0f648e91842638024f77aacc8e7e01dd2e775f2c2a5d22872d735446fb839ea8" exitCode=0
Sep 17 09:41:36.069339 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:36.068908    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerDied","Data":"0f648e91842638024f77aacc8e7e01dd2e775f2c2a5d22872d735446fb839ea8"}
Sep 17 09:41:37.077031 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.076986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerStarted","Data":"2a6aaa3577fb6092790c336c21dbc2e40c2372c6bba4e4e2742fcc2daa33d53d"}
Sep 17 09:41:37.077455 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.077066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerStarted","Data":"81aa57f66d4483a9da3d771c9e04c06fcdf667b4fc1ede18ea6fed7bdc0f30f2"}
Sep 17 09:41:37.077455 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.077095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerStarted","Data":"37b25db9475c805ddd30524c05f1ad84ec5613bf7513d003aa1179ba2f625dc9"}
Sep 17 09:41:37.112566 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.112494    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podStartSLOduration=11.112471496 podStartE2EDuration="11.112471496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:41:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:41:37.111464746 +0000 UTC m=+702.177676511" watchObservedRunningTime="2026-09-17 09:41:37.112471496 +0000 UTC m=+702.178683262"
Sep 17 09:41:37.304213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.304147    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:37.304416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.304258    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:37.304416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:37.304287    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:39.303647 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:39.303585    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:39.304189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:39.303693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:39.304189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:39.303718    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:39.305181 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:39.305128    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
Sep 17 09:41:39.305309 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:39.305155    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Sep 17 09:41:39.305309 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:39.305210    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 17 09:41:42.306893 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:42.306451    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
Sep 17 09:41:42.307853 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:42.307771    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Sep 17 09:41:42.308053 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:42.308032    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 17 09:41:45.304433 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:45.304386    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Sep 17 09:41:45.305314 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:45.305288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:45.306325 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:45.306300    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:45.311092 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:45.311069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:46.122472 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:46.122436    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:48.304375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:48.304274    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused"
Sep 17 09:41:51.304008 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:51.303977    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:41:51.304725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:41:51.304707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:42:55.144384 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.144345    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"]
Sep 17 09:42:55.144905 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.144607    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry" containerID="cri-o://37b25db9475c805ddd30524c05f1ad84ec5613bf7513d003aa1179ba2f625dc9" gracePeriod=30
Sep 17 09:42:55.144905 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.144657    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline" containerID="cri-o://2a6aaa3577fb6092790c336c21dbc2e40c2372c6bba4e4e2742fcc2daa33d53d" gracePeriod=30
Sep 17 09:42:55.144905 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.144659    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online" containerID="cri-o://81aa57f66d4483a9da3d771c9e04c06fcdf667b4fc1ede18ea6fed7bdc0f30f2" gracePeriod=30
Sep 17 09:42:55.157968 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.157945    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-pw8s6"]
Sep 17 09:42:55.158115 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.158098    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-pw8s6" podUID="8d25aff0-35ce-4088-9e1b-30cc3be4490b" containerName="postgres" containerID="cri-o://64a4656903f26da6ec79ac6c2c909f247cb362886b7c78aca88a6631a9e7f332" gracePeriod=30
Sep 17 09:42:55.368416 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.368385    2558 generic.go:356] "Generic (PLEG): container finished" podID="8d25aff0-35ce-4088-9e1b-30cc3be4490b" containerID="64a4656903f26da6ec79ac6c2c909f247cb362886b7c78aca88a6631a9e7f332" exitCode=0
Sep 17 09:42:55.368545 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.368427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-pw8s6" event={"ID":"8d25aff0-35ce-4088-9e1b-30cc3be4490b","Type":"ContainerDied","Data":"64a4656903f26da6ec79ac6c2c909f247cb362886b7c78aca88a6631a9e7f332"}
Sep 17 09:42:55.402567 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.402509    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:42:55.433651 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.433625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggmjk\" (UniqueName: \"kubernetes.io/projected/8d25aff0-35ce-4088-9e1b-30cc3be4490b-kube-api-access-ggmjk\") pod \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") "
Sep 17 09:42:55.433783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.433694    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8d25aff0-35ce-4088-9e1b-30cc3be4490b-postgresdata\") pod \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\" (UID: \"8d25aff0-35ce-4088-9e1b-30cc3be4490b\") "
Sep 17 09:42:55.435999 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.435974    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d25aff0-35ce-4088-9e1b-30cc3be4490b-kube-api-access-ggmjk" (OuterVolumeSpecName: "kube-api-access-ggmjk") pod "8d25aff0-35ce-4088-9e1b-30cc3be4490b" (UID: "8d25aff0-35ce-4088-9e1b-30cc3be4490b"). InnerVolumeSpecName "kube-api-access-ggmjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:42:55.468643 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.468613    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d25aff0-35ce-4088-9e1b-30cc3be4490b-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "8d25aff0-35ce-4088-9e1b-30cc3be4490b" (UID: "8d25aff0-35ce-4088-9e1b-30cc3be4490b"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:42:55.534447 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.534418    2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8d25aff0-35ce-4088-9e1b-30cc3be4490b-postgresdata\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:42:55.534447 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:55.534441    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggmjk\" (UniqueName: \"kubernetes.io/projected/8d25aff0-35ce-4088-9e1b-30cc3be4490b-kube-api-access-ggmjk\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:42:56.117830 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.117788    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 17 09:42:56.374709 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.374679    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerID="81aa57f66d4483a9da3d771c9e04c06fcdf667b4fc1ede18ea6fed7bdc0f30f2" exitCode=0
Sep 17 09:42:56.375140 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.374755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerDied","Data":"81aa57f66d4483a9da3d771c9e04c06fcdf667b4fc1ede18ea6fed7bdc0f30f2"}
Sep 17 09:42:56.375947 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.375924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-pw8s6" event={"ID":"8d25aff0-35ce-4088-9e1b-30cc3be4490b","Type":"ContainerDied","Data":"0090a6cac8b63787c891e0212d2f29f3dc49e9be7354b618390c95eb5e439c85"}
Sep 17 09:42:56.376043 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.375964    2558 scope.go:117] "RemoveContainer" containerID="64a4656903f26da6ec79ac6c2c909f247cb362886b7c78aca88a6631a9e7f332"
Sep 17 09:42:56.376043 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.375934    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-pw8s6"
Sep 17 09:42:56.396868 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.396850    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-pw8s6"]
Sep 17 09:42:56.401185 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:56.401149    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-pw8s6"]
Sep 17 09:42:57.460138 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:42:57.460106    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d25aff0-35ce-4088-9e1b-30cc3be4490b" path="/var/lib/kubelet/pods/8d25aff0-35ce-4088-9e1b-30cc3be4490b/volumes"
Sep 17 09:43:06.118036 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:06.117990    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 17 09:43:16.118552 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:16.118510    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
Sep 17 09:43:16.118930 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:16.118657    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:43:25.306828 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.306790    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
Sep 17 09:43:25.483223 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.483191    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerID="2a6aaa3577fb6092790c336c21dbc2e40c2372c6bba4e4e2742fcc2daa33d53d" exitCode=137
Sep 17 09:43:25.483223 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.483215    2558 generic.go:356] "Generic (PLEG): container finished" podID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerID="37b25db9475c805ddd30524c05f1ad84ec5613bf7513d003aa1179ba2f625dc9" exitCode=137
Sep 17 09:43:25.483392 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.483249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerDied","Data":"2a6aaa3577fb6092790c336c21dbc2e40c2372c6bba4e4e2742fcc2daa33d53d"}
Sep 17 09:43:25.483392 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.483287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerDied","Data":"37b25db9475c805ddd30524c05f1ad84ec5613bf7513d003aa1179ba2f625dc9"}
Sep 17 09:43:25.786039 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.786012    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:43:25.856498 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.856473    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8dd97c-2504-4362-a630-79e200cf1b61-feast-data\") pod \"7f8dd97c-2504-4362-a630-79e200cf1b61\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") "
Sep 17 09:43:25.856721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.856518    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhjzk\" (UniqueName: \"kubernetes.io/projected/7f8dd97c-2504-4362-a630-79e200cf1b61-kube-api-access-nhjzk\") pod \"7f8dd97c-2504-4362-a630-79e200cf1b61\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") "
Sep 17 09:43:25.856721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.856555    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-registry-tls\") pod \"7f8dd97c-2504-4362-a630-79e200cf1b61\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") "
Sep 17 09:43:25.856721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.856572    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls\") pod \"7f8dd97c-2504-4362-a630-79e200cf1b61\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") "
Sep 17 09:43:25.856721 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.856602    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-offline-tls\") pod \"7f8dd97c-2504-4362-a630-79e200cf1b61\" (UID: \"7f8dd97c-2504-4362-a630-79e200cf1b61\") "
Sep 17 09:43:25.858603 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.858572    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8dd97c-2504-4362-a630-79e200cf1b61-kube-api-access-nhjzk" (OuterVolumeSpecName: "kube-api-access-nhjzk") pod "7f8dd97c-2504-4362-a630-79e200cf1b61" (UID: "7f8dd97c-2504-4362-a630-79e200cf1b61"). InnerVolumeSpecName "kube-api-access-nhjzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:43:25.858699 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.858663    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7f8dd97c-2504-4362-a630-79e200cf1b61" (UID: "7f8dd97c-2504-4362-a630-79e200cf1b61"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:43:25.859005 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.858985    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls" (OuterVolumeSpecName: "online-tls") pod "7f8dd97c-2504-4362-a630-79e200cf1b61" (UID: "7f8dd97c-2504-4362-a630-79e200cf1b61"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:43:25.859067 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.859009    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7f8dd97c-2504-4362-a630-79e200cf1b61" (UID: "7f8dd97c-2504-4362-a630-79e200cf1b61"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:43:25.864274 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.864255    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f8dd97c-2504-4362-a630-79e200cf1b61-feast-data" (OuterVolumeSpecName: "feast-data") pod "7f8dd97c-2504-4362-a630-79e200cf1b61" (UID: "7f8dd97c-2504-4362-a630-79e200cf1b61"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:43:25.957967 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.957932    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:43:25.957967 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.957960    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7f8dd97c-2504-4362-a630-79e200cf1b61-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:43:25.957967 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.957973    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhjzk\" (UniqueName: \"kubernetes.io/projected/7f8dd97c-2504-4362-a630-79e200cf1b61-kube-api-access-nhjzk\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:43:25.958213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.957985    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:43:25.958213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:25.957996    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7f8dd97c-2504-4362-a630-79e200cf1b61-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:43:26.488656 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.488619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j" event={"ID":"7f8dd97c-2504-4362-a630-79e200cf1b61","Type":"ContainerDied","Data":"bcd4e7b08b40230cf2f6f8905d580a1a8b9fe58ca3ce028018c9221c083f5d9f"}
Sep 17 09:43:26.488656 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.488651    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"
Sep 17 09:43:26.489120 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.488692    2558 scope.go:117] "RemoveContainer" containerID="2a6aaa3577fb6092790c336c21dbc2e40c2372c6bba4e4e2742fcc2daa33d53d"
Sep 17 09:43:26.497089 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.497069    2558 scope.go:117] "RemoveContainer" containerID="81aa57f66d4483a9da3d771c9e04c06fcdf667b4fc1ede18ea6fed7bdc0f30f2"
Sep 17 09:43:26.504800 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.504785    2558 scope.go:117] "RemoveContainer" containerID="37b25db9475c805ddd30524c05f1ad84ec5613bf7513d003aa1179ba2f625dc9"
Sep 17 09:43:26.513191 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.513173    2558 scope.go:117] "RemoveContainer" containerID="0f648e91842638024f77aacc8e7e01dd2e775f2c2a5d22872d735446fb839ea8"
Sep 17 09:43:26.521172 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.521143    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"]
Sep 17 09:43:26.521359 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.521344    2558 scope.go:117] "RemoveContainer" containerID="4add4d8f50e84feded4a6d159bad089f77426154d80d56b02c84b0c6fdd31c3b"
Sep 17 09:43:26.528390 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:26.528365    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-f865fbccf-2z27j"]
Sep 17 09:43:27.460023 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:43:27.459991    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" path="/var/lib/kubelet/pods/7f8dd97c-2504-4362-a630-79e200cf1b61/volumes"
Sep 17 09:44:55.350924 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:44:55.350891    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:44:55.352666 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:44:55.352645    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:45:30.778352 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778319    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5llz5"]
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778564    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d25aff0-35ce-4088-9e1b-30cc3be4490b" containerName="postgres"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778576    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d25aff0-35ce-4088-9e1b-30cc3be4490b" containerName="postgres"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778586    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778595    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778604    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="feast-init"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778609    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="feast-init"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778618    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778623    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778629    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778634    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778645    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="feast-apply"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778650    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="feast-apply"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778692    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="offline"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778700    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="online"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778706    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8dd97c-2504-4362-a630-79e200cf1b61" containerName="registry"
Sep 17 09:45:30.778939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.778712    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d25aff0-35ce-4088-9e1b-30cc3be4490b" containerName="postgres"
Sep 17 09:45:30.781418 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.781396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:45:30.785514 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.785496    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-fh4lb\""
Sep 17 09:45:30.785698 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.785679    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 17 09:45:30.786757 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.786738    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 17 09:45:30.804058 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.804036    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5llz5"]
Sep 17 09:45:30.914240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:30.914209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwf44\" (UniqueName: \"kubernetes.io/projected/449a68f8-bc3f-48f4-b20a-83de67430599-kube-api-access-fwf44\") pod \"redis-69bbd798b6-5llz5\" (UID: \"449a68f8-bc3f-48f4-b20a-83de67430599\") " pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:45:31.015277 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:31.015237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwf44\" (UniqueName: \"kubernetes.io/projected/449a68f8-bc3f-48f4-b20a-83de67430599-kube-api-access-fwf44\") pod \"redis-69bbd798b6-5llz5\" (UID: \"449a68f8-bc3f-48f4-b20a-83de67430599\") " pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:45:31.025302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:31.025270    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwf44\" (UniqueName: \"kubernetes.io/projected/449a68f8-bc3f-48f4-b20a-83de67430599-kube-api-access-fwf44\") pod \"redis-69bbd798b6-5llz5\" (UID: \"449a68f8-bc3f-48f4-b20a-83de67430599\") " pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:45:31.090286 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:31.090195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:45:31.366607 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:31.366535    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5llz5"]
Sep 17 09:45:31.369887 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:45:31.369852    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod449a68f8_bc3f_48f4_b20a_83de67430599.slice/crio-151b3afd184056c36a8f5a4c15b29358703654e19639ef723d67ed1f5202be9f WatchSource:0}: Error finding container 151b3afd184056c36a8f5a4c15b29358703654e19639ef723d67ed1f5202be9f: Status 404 returned error can't find the container with id 151b3afd184056c36a8f5a4c15b29358703654e19639ef723d67ed1f5202be9f
Sep 17 09:45:31.899256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:31.899215    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5" event={"ID":"449a68f8-bc3f-48f4-b20a-83de67430599","Type":"ContainerStarted","Data":"151b3afd184056c36a8f5a4c15b29358703654e19639ef723d67ed1f5202be9f"}
Sep 17 09:45:33.907974 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:33.907935    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5" event={"ID":"449a68f8-bc3f-48f4-b20a-83de67430599","Type":"ContainerStarted","Data":"2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a"}
Sep 17 09:45:33.926153 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:33.926105    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5" podStartSLOduration=2.413499914 podStartE2EDuration="3.926091356s" totalImagesPullingTime="1.512591442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:45:33.925723389 +0000 UTC m=+938.991935155" watchObservedRunningTime="2026-09-17 09:45:33.926091356 +0000 UTC m=+938.992303120"
Sep 17 09:45:36.196280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.196243    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zc9kv"]
Sep 17 09:45:36.199554 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.199533    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.202410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.202385    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 17 09:45:36.207738 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.207713    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zc9kv"]
Sep 17 09:45:36.256483 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.256450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/77ccc657-ab92-4d53-898c-392468bced2a-postgresdata\") pod \"postgres-864846d4f5-zc9kv\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") " pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.256636 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.256517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nplp\" (UniqueName: \"kubernetes.io/projected/77ccc657-ab92-4d53-898c-392468bced2a-kube-api-access-2nplp\") pod \"postgres-864846d4f5-zc9kv\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") " pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.357540 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.357502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/77ccc657-ab92-4d53-898c-392468bced2a-postgresdata\") pod \"postgres-864846d4f5-zc9kv\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") " pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.357709 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.357626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nplp\" (UniqueName: \"kubernetes.io/projected/77ccc657-ab92-4d53-898c-392468bced2a-kube-api-access-2nplp\") pod \"postgres-864846d4f5-zc9kv\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") " pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.357829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.357813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/77ccc657-ab92-4d53-898c-392468bced2a-postgresdata\") pod \"postgres-864846d4f5-zc9kv\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") " pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.366839 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.366814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nplp\" (UniqueName: \"kubernetes.io/projected/77ccc657-ab92-4d53-898c-392468bced2a-kube-api-access-2nplp\") pod \"postgres-864846d4f5-zc9kv\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") " pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.509120 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.509087    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:45:36.775950 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.775873    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zc9kv"]
Sep 17 09:45:36.920479 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.920437    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv" event={"ID":"77ccc657-ab92-4d53-898c-392468bced2a","Type":"ContainerStarted","Data":"1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962"}
Sep 17 09:45:36.920479 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.920481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv" event={"ID":"77ccc657-ab92-4d53-898c-392468bced2a","Type":"ContainerStarted","Data":"bd36731b2d36ad95b03dd52f7977c1c0173d32d218919075d76a591967ebb28f"}
Sep 17 09:45:36.937784 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:36.937729    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv" podStartSLOduration=0.937709425 podStartE2EDuration="937.709425ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:45:36.93682057 +0000 UTC m=+942.003032344" watchObservedRunningTime="2026-09-17 09:45:36.937709425 +0000 UTC m=+942.003921191"
Sep 17 09:45:41.767474 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.767433    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"]
Sep 17 09:45:41.772955 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.772936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.776051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.776030    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 17 09:45:41.776051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.776047    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 17 09:45:41.776246 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.776097    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 17 09:45:41.776319 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.776305    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-rjkst\""
Sep 17 09:45:41.785547 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.785431    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"]
Sep 17 09:45:41.897634 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.897598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-feast-data\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.897824 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.897647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg5xt\" (UniqueName: \"kubernetes.io/projected/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-kube-api-access-bg5xt\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.897824 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.897681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.897824 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.897791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-registry-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.998875 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.998839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-feast-data\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.998875 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.998876    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg5xt\" (UniqueName: \"kubernetes.io/projected/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-kube-api-access-bg5xt\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.999109 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.998896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.999109 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.998953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-registry-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:41.999109 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:45:41.999077    2558 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 17 09:45:41.999285 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:45:41.999145    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls podName:34b92f86-1d3e-4d77-b0a2-eec4eb59308b nodeName:}" failed. No retries permitted until 2026-09-17 09:45:42.49912472 +0000 UTC m=+947.565336466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls") pod "feast-credit-scoring-67bdf5dc97-nlk4s" (UID: "34b92f86-1d3e-4d77-b0a2-eec4eb59308b") : secret "feast-credit-scoring-online-tls" not found
Sep 17 09:45:41.999409 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:41.999387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-feast-data\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:42.001558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:42.001534    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-registry-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:42.007953 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:42.007924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg5xt\" (UniqueName: \"kubernetes.io/projected/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-kube-api-access-bg5xt\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:42.504315 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:42.504283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:42.506664 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:42.506642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls\") pod \"feast-credit-scoring-67bdf5dc97-nlk4s\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") " pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:42.682891 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:42.682847    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:42.958308 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:42.958226    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"]
Sep 17 09:45:42.961276 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:45:42.961248    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b92f86_1d3e_4d77_b0a2_eec4eb59308b.slice/crio-ddf87428338da5f13847b05590ef8e55a31f35dc4b0e0cb858f4c150d9a417df WatchSource:0}: Error finding container ddf87428338da5f13847b05590ef8e55a31f35dc4b0e0cb858f4c150d9a417df: Status 404 returned error can't find the container with id ddf87428338da5f13847b05590ef8e55a31f35dc4b0e0cb858f4c150d9a417df
Sep 17 09:45:43.945125 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:43.945088    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerStarted","Data":"84968a28ef1f271b1eeca0fd8fdb2bc368f18e4c08467fec2352e3f8ac1ebfcb"}
Sep 17 09:45:43.945338 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:43.945136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerStarted","Data":"ddf87428338da5f13847b05590ef8e55a31f35dc4b0e0cb858f4c150d9a417df"}
Sep 17 09:45:44.950001 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:44.949909    2558 generic.go:356] "Generic (PLEG): container finished" podID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerID="84968a28ef1f271b1eeca0fd8fdb2bc368f18e4c08467fec2352e3f8ac1ebfcb" exitCode=0
Sep 17 09:45:44.950452 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:44.949995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerDied","Data":"84968a28ef1f271b1eeca0fd8fdb2bc368f18e4c08467fec2352e3f8ac1ebfcb"}
Sep 17 09:45:45.955890 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:45.955844    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerStarted","Data":"add0058f03c894aca76d1b5cff7d3a7243c750e9b442f1bd2bd2bfa5e1cde6c1"}
Sep 17 09:45:52.982209 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:52.982148    2558 generic.go:356] "Generic (PLEG): container finished" podID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerID="add0058f03c894aca76d1b5cff7d3a7243c750e9b442f1bd2bd2bfa5e1cde6c1" exitCode=0
Sep 17 09:45:52.982209 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:52.982199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerDied","Data":"add0058f03c894aca76d1b5cff7d3a7243c750e9b442f1bd2bd2bfa5e1cde6c1"}
Sep 17 09:45:53.990666 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:53.990629    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerStarted","Data":"c38a695eaa2bf520fdc4823bdd16074282430dde25c13d40ae300be31e0765db"}
Sep 17 09:45:53.991145 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:53.990697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerStarted","Data":"472fb7714b97125dba4379960802b76681267f17fd0d8083a7408c7f21ed141d"}
Sep 17 09:45:54.015238 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:54.015187    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podStartSLOduration=13.015146938 podStartE2EDuration="13.015146938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:45:54.013296591 +0000 UTC m=+959.079508358" watchObservedRunningTime="2026-09-17 09:45:54.015146938 +0000 UTC m=+959.081358702"
Sep 17 09:45:54.683703 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:54.683665    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:54.683911 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:54.683751    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:45:54.685092 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:54.685055    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Sep 17 09:45:54.685238 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:54.685094    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 17 09:45:57.684199 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:57.684132    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Sep 17 09:45:57.690682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:45:57.684649    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 17 09:46:00.683716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:00.683667    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Sep 17 09:46:00.689757 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:00.689725    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:46:00.690226 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:00.690198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:46:00.693394 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:00.693373    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:46:02.683842 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:02.683793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:46:03.683131 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:03.683091    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
Sep 17 09:46:06.684365 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:06.684330    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:46:06.685065 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:06.685046    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:46:07.586702 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.586667    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"]
Sep 17 09:46:07.591718 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.591693    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.594974 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.594954    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 17 09:46:07.595358 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.595339    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-scvxk\""
Sep 17 09:46:07.595456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.595409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 17 09:46:07.595549 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.595529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 17 09:46:07.611417 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.611389    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"]
Sep 17 09:46:07.699965 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.699928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-online-tls\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.699965 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.699967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-registry-tls\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.700407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.699986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-feast-data\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.700407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.700004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvtzl\" (UniqueName: \"kubernetes.io/projected/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-kube-api-access-cvtzl\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.801302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.801269    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-online-tls\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.801302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.801308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-registry-tls\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.801510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.801326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-feast-data\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.801510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.801445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvtzl\" (UniqueName: \"kubernetes.io/projected/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-kube-api-access-cvtzl\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.801736 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.801708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-feast-data\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.803816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.803792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-registry-tls\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.803914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.803856    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-online-tls\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.810047 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.810028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvtzl\" (UniqueName: \"kubernetes.io/projected/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-kube-api-access-cvtzl\") pod \"feast-driver-ranking-6fc9f8d646-jlw9q\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") " pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:07.902533 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:07.902454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:08.182669 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:08.182543    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"]
Sep 17 09:46:08.186335 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:46:08.186308    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6fb0cde_9ff6_4857_bb23_6c32b64d2e03.slice/crio-77129905c5d408d5e938266439797326c60b7b60a17e2db7d6f9eac9cd7ddbc1 WatchSource:0}: Error finding container 77129905c5d408d5e938266439797326c60b7b60a17e2db7d6f9eac9cd7ddbc1: Status 404 returned error can't find the container with id 77129905c5d408d5e938266439797326c60b7b60a17e2db7d6f9eac9cd7ddbc1
Sep 17 09:46:09.051032 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:09.050994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerStarted","Data":"d9b3f43f3083cfab6fb30b5f1490c8869cb8c70a91fdc1239ff759aa8929144d"}
Sep 17 09:46:09.051449 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:09.051051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerStarted","Data":"77129905c5d408d5e938266439797326c60b7b60a17e2db7d6f9eac9cd7ddbc1"}
Sep 17 09:46:13.073992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:13.073958    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerID="d9b3f43f3083cfab6fb30b5f1490c8869cb8c70a91fdc1239ff759aa8929144d" exitCode=0
Sep 17 09:46:13.074390 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:13.074031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerDied","Data":"d9b3f43f3083cfab6fb30b5f1490c8869cb8c70a91fdc1239ff759aa8929144d"}
Sep 17 09:46:14.079650 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:14.079616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerStarted","Data":"255545ae0e2ed829dd32399660bfc968861e748d3c50441f5537b430b9006901"}
Sep 17 09:46:20.104208 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:20.104150    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerID="255545ae0e2ed829dd32399660bfc968861e748d3c50441f5537b430b9006901" exitCode=0
Sep 17 09:46:20.104570 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:20.104220    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerDied","Data":"255545ae0e2ed829dd32399660bfc968861e748d3c50441f5537b430b9006901"}
Sep 17 09:46:21.110519 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:21.110482    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerStarted","Data":"7d50d5076ff96bd77b4f8cf118e1bd14fb244c953873898e7831ed59799e346a"}
Sep 17 09:46:21.111037 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:21.110546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerStarted","Data":"4c651d600ba107b81955a6ac529099544d3cc4219094644f68c992b157baba2c"}
Sep 17 09:46:21.135843 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:21.135778    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podStartSLOduration=14.135762387 podStartE2EDuration="14.135762387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:46:21.135483078 +0000 UTC m=+986.201694844" watchObservedRunningTime="2026-09-17 09:46:21.135762387 +0000 UTC m=+986.201974152"
Sep 17 09:46:22.903431 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:22.903385    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:22.903858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:22.903516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:22.904899 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:22.904870    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 17 09:46:22.905011 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:22.904885    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 17 09:46:25.903239 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:25.903197    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 17 09:46:25.903628 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:25.903267    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 17 09:46:27.903126 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:27.903091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:27.903662 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:27.903235    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:28.903270 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:28.903224    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused"
Sep 17 09:46:28.909213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:28.909182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:29.148504 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:29.148462    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:31.903422 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:31.903389    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:46:31.904176 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:46:31.904141    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:47:50.747371 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:50.747337    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"]
Sep 17 09:47:50.747821 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:50.747535    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9" podUID="5763b283-954d-42e6-bd26-a2720e31188f" containerName="manager" containerID="cri-o://ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336" gracePeriod=10
Sep 17 09:47:50.995278 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:50.995249    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:47:51.087860 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.087790    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4dll\" (UniqueName: \"kubernetes.io/projected/5763b283-954d-42e6-bd26-a2720e31188f-kube-api-access-m4dll\") pod \"5763b283-954d-42e6-bd26-a2720e31188f\" (UID: \"5763b283-954d-42e6-bd26-a2720e31188f\") "
Sep 17 09:47:51.092148 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.092112    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5763b283-954d-42e6-bd26-a2720e31188f-kube-api-access-m4dll" (OuterVolumeSpecName: "kube-api-access-m4dll") pod "5763b283-954d-42e6-bd26-a2720e31188f" (UID: "5763b283-954d-42e6-bd26-a2720e31188f"). InnerVolumeSpecName "kube-api-access-m4dll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:47:51.147508 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.147478    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"]
Sep 17 09:47:51.147723 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.147693    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry" containerID="cri-o://472fb7714b97125dba4379960802b76681267f17fd0d8083a7408c7f21ed141d" gracePeriod=30
Sep 17 09:47:51.147849 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.147760    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online" containerID="cri-o://c38a695eaa2bf520fdc4823bdd16074282430dde25c13d40ae300be31e0765db" gracePeriod=30
Sep 17 09:47:51.153402 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.153379    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"]
Sep 17 09:47:51.153620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.153587    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry" containerID="cri-o://4c651d600ba107b81955a6ac529099544d3cc4219094644f68c992b157baba2c" gracePeriod=30
Sep 17 09:47:51.153686 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.153598    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online" containerID="cri-o://7d50d5076ff96bd77b4f8cf118e1bd14fb244c953873898e7831ed59799e346a" gracePeriod=30
Sep 17 09:47:51.189045 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.189020    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4dll\" (UniqueName: \"kubernetes.io/projected/5763b283-954d-42e6-bd26-a2720e31188f-kube-api-access-m4dll\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:47:51.459635 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.459558    2558 generic.go:356] "Generic (PLEG): container finished" podID="5763b283-954d-42e6-bd26-a2720e31188f" containerID="ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336" exitCode=0
Sep 17 09:47:51.459770 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.459677    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"
Sep 17 09:47:51.459822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.459677    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9" event={"ID":"5763b283-954d-42e6-bd26-a2720e31188f","Type":"ContainerDied","Data":"ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336"}
Sep 17 09:47:51.459861 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.459837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9" event={"ID":"5763b283-954d-42e6-bd26-a2720e31188f","Type":"ContainerDied","Data":"2cfc1ddedc82364caba9a713dfa3b884555841647f96b8538eb0903d206669c9"}
Sep 17 09:47:51.459919 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.459870    2558 scope.go:117] "RemoveContainer" containerID="ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336"
Sep 17 09:47:51.470391 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.470266    2558 scope.go:117] "RemoveContainer" containerID="ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336"
Sep 17 09:47:51.470825 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:47:51.470798    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336\": container with ID starting with ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336 not found: ID does not exist" containerID="ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336"
Sep 17 09:47:51.470913 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.470836    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336"} err="failed to get container status \"ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336\": rpc error: code = NotFound desc = could not find container \"ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336\": container with ID starting with ba3c2c7ef8ec860ceb87d951b8357b98d79342224c791c3b8a5024060bddb336 not found: ID does not exist"
Sep 17 09:47:51.483923 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.483902    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"]
Sep 17 09:47:51.487713 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:51.487693    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-b78cb886d-2xrv9"]
Sep 17 09:47:52.466320 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:52.466291    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerID="7d50d5076ff96bd77b4f8cf118e1bd14fb244c953873898e7831ed59799e346a" exitCode=0
Sep 17 09:47:52.466786 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:52.466367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerDied","Data":"7d50d5076ff96bd77b4f8cf118e1bd14fb244c953873898e7831ed59799e346a"}
Sep 17 09:47:52.469495 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:52.469474    2558 generic.go:356] "Generic (PLEG): container finished" podID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerID="c38a695eaa2bf520fdc4823bdd16074282430dde25c13d40ae300be31e0765db" exitCode=0
Sep 17 09:47:52.469598 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:52.469537    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerDied","Data":"c38a695eaa2bf520fdc4823bdd16074282430dde25c13d40ae300be31e0765db"}
Sep 17 09:47:53.427019 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.426984    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zc9kv"]
Sep 17 09:47:53.427217 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.427151    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv" podUID="77ccc657-ab92-4d53-898c-392468bced2a" containerName="postgres" containerID="cri-o://1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962" gracePeriod=30
Sep 17 09:47:53.432623 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.432592    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5llz5"]
Sep 17 09:47:53.432803 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.432779    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5" podUID="449a68f8-bc3f-48f4-b20a-83de67430599" containerName="redis" containerID="cri-o://2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a" gracePeriod=30
Sep 17 09:47:53.459711 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.459681    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5763b283-954d-42e6-bd26-a2720e31188f" path="/var/lib/kubelet/pods/5763b283-954d-42e6-bd26-a2720e31188f/volumes"
Sep 17 09:47:53.691514 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.691488    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:47:53.694265 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.694248    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:47:53.808986 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.808954    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/77ccc657-ab92-4d53-898c-392468bced2a-postgresdata\") pod \"77ccc657-ab92-4d53-898c-392468bced2a\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") "
Sep 17 09:47:53.809187 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.808994    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwf44\" (UniqueName: \"kubernetes.io/projected/449a68f8-bc3f-48f4-b20a-83de67430599-kube-api-access-fwf44\") pod \"449a68f8-bc3f-48f4-b20a-83de67430599\" (UID: \"449a68f8-bc3f-48f4-b20a-83de67430599\") "
Sep 17 09:47:53.809187 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.809017    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nplp\" (UniqueName: \"kubernetes.io/projected/77ccc657-ab92-4d53-898c-392468bced2a-kube-api-access-2nplp\") pod \"77ccc657-ab92-4d53-898c-392468bced2a\" (UID: \"77ccc657-ab92-4d53-898c-392468bced2a\") "
Sep 17 09:47:53.811085 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.811057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/449a68f8-bc3f-48f4-b20a-83de67430599-kube-api-access-fwf44" (OuterVolumeSpecName: "kube-api-access-fwf44") pod "449a68f8-bc3f-48f4-b20a-83de67430599" (UID: "449a68f8-bc3f-48f4-b20a-83de67430599"). InnerVolumeSpecName "kube-api-access-fwf44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:47:53.811189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.811098    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ccc657-ab92-4d53-898c-392468bced2a-kube-api-access-2nplp" (OuterVolumeSpecName: "kube-api-access-2nplp") pod "77ccc657-ab92-4d53-898c-392468bced2a" (UID: "77ccc657-ab92-4d53-898c-392468bced2a"). InnerVolumeSpecName "kube-api-access-2nplp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:47:53.838427 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.838398    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77ccc657-ab92-4d53-898c-392468bced2a-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "77ccc657-ab92-4d53-898c-392468bced2a" (UID: "77ccc657-ab92-4d53-898c-392468bced2a"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:47:53.909558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.909530    2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/77ccc657-ab92-4d53-898c-392468bced2a-postgresdata\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:47:53.909558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.909556    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwf44\" (UniqueName: \"kubernetes.io/projected/449a68f8-bc3f-48f4-b20a-83de67430599-kube-api-access-fwf44\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:47:53.909690 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:53.909571    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nplp\" (UniqueName: \"kubernetes.io/projected/77ccc657-ab92-4d53-898c-392468bced2a-kube-api-access-2nplp\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:47:54.477982 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.477953    2558 generic.go:356] "Generic (PLEG): container finished" podID="77ccc657-ab92-4d53-898c-392468bced2a" containerID="1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962" exitCode=0
Sep 17 09:47:54.478106 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.477996    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv"
Sep 17 09:47:54.478106 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.478042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv" event={"ID":"77ccc657-ab92-4d53-898c-392468bced2a","Type":"ContainerDied","Data":"1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962"}
Sep 17 09:47:54.478106 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.478085    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zc9kv" event={"ID":"77ccc657-ab92-4d53-898c-392468bced2a","Type":"ContainerDied","Data":"bd36731b2d36ad95b03dd52f7977c1c0173d32d218919075d76a591967ebb28f"}
Sep 17 09:47:54.478271 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.478106    2558 scope.go:117] "RemoveContainer" containerID="1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962"
Sep 17 09:47:54.479448 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.479244    2558 generic.go:356] "Generic (PLEG): container finished" podID="449a68f8-bc3f-48f4-b20a-83de67430599" containerID="2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a" exitCode=0
Sep 17 09:47:54.479448 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.479276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5" event={"ID":"449a68f8-bc3f-48f4-b20a-83de67430599","Type":"ContainerDied","Data":"2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a"}
Sep 17 09:47:54.479448 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.479324    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5" event={"ID":"449a68f8-bc3f-48f4-b20a-83de67430599","Type":"ContainerDied","Data":"151b3afd184056c36a8f5a4c15b29358703654e19639ef723d67ed1f5202be9f"}
Sep 17 09:47:54.479448 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.479286    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-5llz5"
Sep 17 09:47:54.486151 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.486131    2558 scope.go:117] "RemoveContainer" containerID="1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962"
Sep 17 09:47:54.486595 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:47:54.486576    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962\": container with ID starting with 1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962 not found: ID does not exist" containerID="1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962"
Sep 17 09:47:54.486651 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.486606    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962"} err="failed to get container status \"1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962\": rpc error: code = NotFound desc = could not find container \"1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962\": container with ID starting with 1eff224f187530314a850aaf48de0ae4ac4b66fb500457ea3f01ca9e805e2962 not found: ID does not exist"
Sep 17 09:47:54.486651 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.486631    2558 scope.go:117] "RemoveContainer" containerID="2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a"
Sep 17 09:47:54.493990 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.493973    2558 scope.go:117] "RemoveContainer" containerID="2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a"
Sep 17 09:47:54.494280 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:47:54.494261    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a\": container with ID starting with 2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a not found: ID does not exist" containerID="2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a"
Sep 17 09:47:54.494348 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.494287    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a"} err="failed to get container status \"2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a\": rpc error: code = NotFound desc = could not find container \"2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a\": container with ID starting with 2bb2ac4cc8d8db270a040e095c6cc738887926a4d8724d70f7baf99dc03a3e8a not found: ID does not exist"
Sep 17 09:47:54.505099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.505079    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zc9kv"]
Sep 17 09:47:54.506897 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.506878    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zc9kv"]
Sep 17 09:47:54.518318 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.518296    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5llz5"]
Sep 17 09:47:54.524134 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:54.524115    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-5llz5"]
Sep 17 09:47:55.459614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:55.459589    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="449a68f8-bc3f-48f4-b20a-83de67430599" path="/var/lib/kubelet/pods/449a68f8-bc3f-48f4-b20a-83de67430599/volumes"
Sep 17 09:47:55.459926 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:55.459911    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77ccc657-ab92-4d53-898c-392468bced2a" path="/var/lib/kubelet/pods/77ccc657-ab92-4d53-898c-392468bced2a/volumes"
Sep 17 09:47:59.145484 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:47:59.145437    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 17 09:48:00.691240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:00.691196    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 17 09:48:09.145460 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:09.145414    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 17 09:48:10.690564 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:10.690523    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 17 09:48:19.145992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:19.145945    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
Sep 17 09:48:19.146579 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:19.146075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:48:20.690940 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:20.690898    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
Sep 17 09:48:20.691346 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:20.691021    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:48:21.573660 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.573627    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerID="4c651d600ba107b81955a6ac529099544d3cc4219094644f68c992b157baba2c" exitCode=137
Sep 17 09:48:21.573843 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.573702    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerDied","Data":"4c651d600ba107b81955a6ac529099544d3cc4219094644f68c992b157baba2c"}
Sep 17 09:48:21.575930 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.575908    2558 generic.go:356] "Generic (PLEG): container finished" podID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerID="472fb7714b97125dba4379960802b76681267f17fd0d8083a7408c7f21ed141d" exitCode=137
Sep 17 09:48:21.576023 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.575967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerDied","Data":"472fb7714b97125dba4379960802b76681267f17fd0d8083a7408c7f21ed141d"}
Sep 17 09:48:21.812690 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.812663    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:48:21.815221 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.815201    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:48:21.919945 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.919842    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg5xt\" (UniqueName: \"kubernetes.io/projected/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-kube-api-access-bg5xt\") pod \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") "
Sep 17 09:48:21.919945 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.919879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-online-tls\") pod \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") "
Sep 17 09:48:21.919945 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.919920    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-registry-tls\") pod \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") "
Sep 17 09:48:21.919945 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.919939    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls\") pod \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") "
Sep 17 09:48:21.920308 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.920042    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-feast-data\") pod \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") "
Sep 17 09:48:21.920308 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.920091    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-feast-data\") pod \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\" (UID: \"34b92f86-1d3e-4d77-b0a2-eec4eb59308b\") "
Sep 17 09:48:21.920308 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.920119    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-registry-tls\") pod \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") "
Sep 17 09:48:21.920308 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.920144    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvtzl\" (UniqueName: \"kubernetes.io/projected/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-kube-api-access-cvtzl\") pod \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\" (UID: \"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03\") "
Sep 17 09:48:21.920640 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.920602    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-feast-data" (OuterVolumeSpecName: "feast-data") pod "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" (UID: "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:48:21.922334 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.922310    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-kube-api-access-bg5xt" (OuterVolumeSpecName: "kube-api-access-bg5xt") pod "34b92f86-1d3e-4d77-b0a2-eec4eb59308b" (UID: "34b92f86-1d3e-4d77-b0a2-eec4eb59308b"). InnerVolumeSpecName "kube-api-access-bg5xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:48:21.922615 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.922591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-online-tls" (OuterVolumeSpecName: "online-tls") pod "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" (UID: "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:48:21.922717 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.922591    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls" (OuterVolumeSpecName: "online-tls") pod "34b92f86-1d3e-4d77-b0a2-eec4eb59308b" (UID: "34b92f86-1d3e-4d77-b0a2-eec4eb59308b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:48:21.922717 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.922650    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-kube-api-access-cvtzl" (OuterVolumeSpecName: "kube-api-access-cvtzl") pod "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" (UID: "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03"). InnerVolumeSpecName "kube-api-access-cvtzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:48:21.922949 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.922934    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "34b92f86-1d3e-4d77-b0a2-eec4eb59308b" (UID: "34b92f86-1d3e-4d77-b0a2-eec4eb59308b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:48:21.923086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.923065    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" (UID: "b6fb0cde-9ff6-4857-bb23-6c32b64d2e03"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:48:21.929802 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:21.929779    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-feast-data" (OuterVolumeSpecName: "feast-data") pod "34b92f86-1d3e-4d77-b0a2-eec4eb59308b" (UID: "34b92f86-1d3e-4d77-b0a2-eec4eb59308b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:48:22.020834 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020799    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.020834 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020828    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.020834 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020837    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.021050 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020847    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvtzl\" (UniqueName: \"kubernetes.io/projected/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-kube-api-access-cvtzl\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.021050 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020857    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg5xt\" (UniqueName: \"kubernetes.io/projected/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-kube-api-access-bg5xt\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.021050 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020865    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.021050 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020873    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.021050 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.020880    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b92f86-1d3e-4d77-b0a2-eec4eb59308b-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:48:22.581125 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.581092    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"
Sep 17 09:48:22.581125 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.581105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q" event={"ID":"b6fb0cde-9ff6-4857-bb23-6c32b64d2e03","Type":"ContainerDied","Data":"77129905c5d408d5e938266439797326c60b7b60a17e2db7d6f9eac9cd7ddbc1"}
Sep 17 09:48:22.581369 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.581186    2558 scope.go:117] "RemoveContainer" containerID="7d50d5076ff96bd77b4f8cf118e1bd14fb244c953873898e7831ed59799e346a"
Sep 17 09:48:22.583525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.583503    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s" event={"ID":"34b92f86-1d3e-4d77-b0a2-eec4eb59308b","Type":"ContainerDied","Data":"ddf87428338da5f13847b05590ef8e55a31f35dc4b0e0cb858f4c150d9a417df"}
Sep 17 09:48:22.583637 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.583546    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"
Sep 17 09:48:22.589445 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.589418    2558 scope.go:117] "RemoveContainer" containerID="4c651d600ba107b81955a6ac529099544d3cc4219094644f68c992b157baba2c"
Sep 17 09:48:22.598377 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.598352    2558 scope.go:117] "RemoveContainer" containerID="255545ae0e2ed829dd32399660bfc968861e748d3c50441f5537b430b9006901"
Sep 17 09:48:22.605312 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.605294    2558 scope.go:117] "RemoveContainer" containerID="d9b3f43f3083cfab6fb30b5f1490c8869cb8c70a91fdc1239ff759aa8929144d"
Sep 17 09:48:22.607051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.607030    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"]
Sep 17 09:48:22.611628 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.611606    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6fc9f8d646-jlw9q"]
Sep 17 09:48:22.612674 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.612661    2558 scope.go:117] "RemoveContainer" containerID="c38a695eaa2bf520fdc4823bdd16074282430dde25c13d40ae300be31e0765db"
Sep 17 09:48:22.619508 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.619492    2558 scope.go:117] "RemoveContainer" containerID="472fb7714b97125dba4379960802b76681267f17fd0d8083a7408c7f21ed141d"
Sep 17 09:48:22.624758 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.624738    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"]
Sep 17 09:48:22.626549 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.626534    2558 scope.go:117] "RemoveContainer" containerID="add0058f03c894aca76d1b5cff7d3a7243c750e9b442f1bd2bd2bfa5e1cde6c1"
Sep 17 09:48:22.628682 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.628660    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67bdf5dc97-nlk4s"]
Sep 17 09:48:22.633263 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:22.633240    2558 scope.go:117] "RemoveContainer" containerID="84968a28ef1f271b1eeca0fd8fdb2bc368f18e4c08467fec2352e3f8ac1ebfcb"
Sep 17 09:48:23.459121 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:23.459089    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" path="/var/lib/kubelet/pods/34b92f86-1d3e-4d77-b0a2-eec4eb59308b/volumes"
Sep 17 09:48:23.459606 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:23.459592    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" path="/var/lib/kubelet/pods/b6fb0cde-9ff6-4857-bb23-6c32b64d2e03/volumes"
Sep 17 09:48:24.733361 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733325    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"]
Sep 17 09:48:24.733730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733675    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online"
Sep 17 09:48:24.733730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733691    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online"
Sep 17 09:48:24.733730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733711    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="feast-init"
Sep 17 09:48:24.733730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733720    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="feast-init"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733733    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="feast-apply"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733741    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="feast-apply"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733754    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="449a68f8-bc3f-48f4-b20a-83de67430599" containerName="redis"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733762    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="449a68f8-bc3f-48f4-b20a-83de67430599" containerName="redis"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733773    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733781    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733791    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5763b283-954d-42e6-bd26-a2720e31188f" containerName="manager"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733798    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5763b283-954d-42e6-bd26-a2720e31188f" containerName="manager"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733819    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733827    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="feast-init"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733835    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="feast-init"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733843    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="feast-apply"
Sep 17 09:48:24.733852 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733851    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="feast-apply"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733859    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ccc657-ab92-4d53-898c-392468bced2a" containerName="postgres"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733868    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ccc657-ab92-4d53-898c-392468bced2a" containerName="postgres"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733878    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733886    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733935    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5763b283-954d-42e6-bd26-a2720e31188f" containerName="manager"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733945    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="registry"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733953    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="449a68f8-bc3f-48f4-b20a-83de67430599" containerName="redis"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733962    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6fb0cde-9ff6-4857-bb23-6c32b64d2e03" containerName="online"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733970    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="registry"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733977    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b92f86-1d3e-4d77-b0a2-eec4eb59308b" containerName="online"
Sep 17 09:48:24.734267 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.733987    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ccc657-ab92-4d53-898c-392468bced2a" containerName="postgres"
Sep 17 09:48:24.737652 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.737633    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.740594 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.740568    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 09:48:24.740736 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.740575    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 09:48:24.740736 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.740581    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 09:48:24.741172 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.741136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 09:48:24.741172 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.741151    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 09:48:24.741389 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.741136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 09:48:24.742135 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.742120    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4gkvq\""
Sep 17 09:48:24.753691 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.753662    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"]
Sep 17 09:48:24.842377 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.842329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.842559 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.842395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.842559 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.842441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.842559 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.842472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fq68\" (UniqueName: \"kubernetes.io/projected/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-kube-api-access-9fq68\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.842674 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.842563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.842674 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.842605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.943729 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.943689    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.943912 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.943752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.943912 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.943791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.943912 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.943825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fq68\" (UniqueName: \"kubernetes.io/projected/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-kube-api-access-9fq68\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.944101 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:48:24.943999    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 09:48:24.944101 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.944032    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.944101 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:48:24.944068    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls podName:8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0 nodeName:}" failed. No retries permitted until 2026-09-17 09:48:25.444048029 +0000 UTC m=+1110.510259795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-k2zqd" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 09:48:24.944285 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.944108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.944285 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:48:24.944228    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 09:48:24.944285 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:48:24.944272    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls podName:8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0 nodeName:}" failed. No retries permitted until 2026-09-17 09:48:25.444258259 +0000 UTC m=+1110.510470015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-k2zqd" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 09:48:24.944555 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.944535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.946320 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.946290    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.946650 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.946628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:24.960952 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:24.957790    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fq68\" (UniqueName: \"kubernetes.io/projected/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-kube-api-access-9fq68\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:25.448346 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.448305    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:25.448528 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.448362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:25.450726 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.450697    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:25.450850 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.450730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-k2zqd\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:25.648781 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.648747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:25.939582 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.939548    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"]
Sep 17 09:48:25.943969 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:48:25.943935    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a2e3d5e_f203_4824_a9c3_7f9fb0bd4ab0.slice/crio-f06ed2b7db2913d1d33b672f0474eed7fa2ef8eaf7b4fc0fd0f21801b38c4bf5 WatchSource:0}: Error finding container f06ed2b7db2913d1d33b672f0474eed7fa2ef8eaf7b4fc0fd0f21801b38c4bf5: Status 404 returned error can't find the container with id f06ed2b7db2913d1d33b672f0474eed7fa2ef8eaf7b4fc0fd0f21801b38c4bf5
Sep 17 09:48:25.945908 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:25.945891    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 09:48:26.601892 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:26.601848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"f06ed2b7db2913d1d33b672f0474eed7fa2ef8eaf7b4fc0fd0f21801b38c4bf5"}
Sep 17 09:48:38.655966 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:38.655175    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"}
Sep 17 09:48:43.674217 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:43.674183    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerID="5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea" exitCode=0
Sep 17 09:48:43.674601 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:43.674185    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"}
Sep 17 09:48:44.682355 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:44.682318    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"}
Sep 17 09:48:49.701494 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:49.701461    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerID="ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d" exitCode=0
Sep 17 09:48:49.701939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:49.701534    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"}
Sep 17 09:48:50.711378 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:50.711336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"}
Sep 17 09:48:50.711919 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:50.711402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"}
Sep 17 09:48:50.711919 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:50.711424    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"}
Sep 17 09:48:50.711919 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:50.711441    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerStarted","Data":"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"}
Sep 17 09:48:50.743656 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:50.743586    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podStartSLOduration=14.361405276 podStartE2EDuration="26.743562428s" totalImagesPullingTime="12.382157152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:48:50.741303663 +0000 UTC m=+1135.807515430" watchObservedRunningTime="2026-09-17 09:48:50.743562428 +0000 UTC m=+1135.809774199"
Sep 17 09:48:52.650119 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.650059    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:52.650628 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.650131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:52.650628 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.650150    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:52.650628 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.650186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:52.652367 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.652279    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 17 09:48:52.652367 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.652300    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 17 09:48:52.652568 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.652388    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Sep 17 09:48:52.652719 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:52.652693    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Sep 17 09:48:55.649829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.649786    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:55.650321 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.649858    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:55.650321 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.649883    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:55.650321 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.649903    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:55.650855 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.650817    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused"
Sep 17 09:48:55.651000 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.650818    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 17 09:48:55.651156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.651086    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 17 09:48:55.651156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:55.651037    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused"
Sep 17 09:48:58.650051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.650024    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.650467 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.650146    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.650467 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.650388    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.650971 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.650950    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.651075 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.651003    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.651288 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.651272    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.655174 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.655150    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:48:58.751453 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:48:58.751427    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:49:55.373613 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:49:55.373575    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:49:55.374093 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:49:55.373623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:50:01.277469 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.277437    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"]
Sep 17 09:50:01.277903 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.277677    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="registry" containerID="cri-o://a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205" gracePeriod=30
Sep 17 09:50:01.277903 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.277729    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui" containerID="cri-o://d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb" gracePeriod=30
Sep 17 09:50:01.277903 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.277738    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="offline" containerID="cri-o://042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b" gracePeriod=30
Sep 17 09:50:01.277903 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.277741    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online" containerID="cri-o://a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c" gracePeriod=30
Sep 17 09:50:01.769156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.769104    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"]
Sep 17 09:50:01.773398 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.773367    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.778614 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.778583    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lftz8\""
Sep 17 09:50:01.797558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.797517    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"]
Sep 17 09:50:01.869387 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.869337    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.869603 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.869398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.869603 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.869491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.869603 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.869540    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltx96\" (UniqueName: \"kubernetes.io/projected/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-kube-api-access-ltx96\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.869769 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.869605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.869769 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.869669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.970513 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.970469    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.970513 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.970521    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.970759 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.970539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.970759 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.970561    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltx96\" (UniqueName: \"kubernetes.io/projected/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-kube-api-access-ltx96\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.970759 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.970636    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.970759 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.970717    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.971043 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.971013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.973605 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.973581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.973730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.973581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.973946 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.973879    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.974013 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.973956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:01.983406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:01.983384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltx96\" (UniqueName: \"kubernetes.io/projected/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-kube-api-access-ltx96\") pod \"feast-simple-feast-setup-57576b8fcf-4n4z9\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:02.086854 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.086747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:02.375408 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.375055    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"]
Sep 17 09:50:02.377843 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:50:02.377812    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f8f262e_a3fe_4d48_b513_c7cbb2b991a6.slice/crio-a4aa143fa10297761107f961b867260cad174a9d32a79d6bf935ee6b4143a945 WatchSource:0}: Error finding container a4aa143fa10297761107f961b867260cad174a9d32a79d6bf935ee6b4143a945: Status 404 returned error can't find the container with id a4aa143fa10297761107f961b867260cad174a9d32a79d6bf935ee6b4143a945
Sep 17 09:50:02.982858 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.982820    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"83cbcd9a12909263abf6657c0017f3132b081152bd4fb835a06b09ec4ae39727"}
Sep 17 09:50:02.983048 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.982878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"a4aa143fa10297761107f961b867260cad174a9d32a79d6bf935ee6b4143a945"}
Sep 17 09:50:02.986001 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.985974    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerID="d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb" exitCode=0
Sep 17 09:50:02.986001 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.985998    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerID="a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c" exitCode=0
Sep 17 09:50:02.986145 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.986032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"}
Sep 17 09:50:02.986145 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:02.986058    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"}
Sep 17 09:50:08.005748 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:08.005712    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerID="83cbcd9a12909263abf6657c0017f3132b081152bd4fb835a06b09ec4ae39727" exitCode=0
Sep 17 09:50:08.006148 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:08.005767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"83cbcd9a12909263abf6657c0017f3132b081152bd4fb835a06b09ec4ae39727"}
Sep 17 09:50:08.651567 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:08.651522    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 17 09:50:08.749177 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:08.749134    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 17 09:50:09.011679 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:09.011644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"bb3cea789e9e11c37ef89f54ee14c53482cf1a1ed157f5d2f6efad85d1004eb0"}
Sep 17 09:50:14.033412 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:14.033378    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerID="bb3cea789e9e11c37ef89f54ee14c53482cf1a1ed157f5d2f6efad85d1004eb0" exitCode=0
Sep 17 09:50:14.033828 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:14.033457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"bb3cea789e9e11c37ef89f54ee14c53482cf1a1ed157f5d2f6efad85d1004eb0"}
Sep 17 09:50:15.043229 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:15.043189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"b08ac4f3b5e0b9b8b8c902cce1f59c2e938c9b5612606139118debe3f7475042"}
Sep 17 09:50:15.043733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:15.043254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"8dfcbd6bb202c433f2b8bf92c15703faf2585dbb4ce219a119dbdcbf9ed5960f"}
Sep 17 09:50:15.043733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:15.043274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"f4dc30c3da91707eea7ac997dc3fc55771d128a811a2a12c9d43a8016404c585"}
Sep 17 09:50:15.043733 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:15.043292    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerStarted","Data":"e49a1e1d4091ace39115b2c2ec54b11e935eb5197d3cbd8d791c8bb240377ba4"}
Sep 17 09:50:15.076076 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:15.076001    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podStartSLOduration=14.07597948 podStartE2EDuration="14.07597948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:50:15.073713684 +0000 UTC m=+1220.139925472" watchObservedRunningTime="2026-09-17 09:50:15.07597948 +0000 UTC m=+1220.142191246"
Sep 17 09:50:17.087757 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.087712    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:17.088342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.087784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:17.088342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.087804    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:17.088342 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.087937    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:17.090344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.090187    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Sep 17 09:50:17.090344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.090220    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Sep 17 09:50:17.090344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.090235    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Sep 17 09:50:17.090344 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:17.090332    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Sep 17 09:50:18.651822 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:18.651775    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 17 09:50:18.749653 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:18.749593    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 17 09:50:20.087535 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:20.087489    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused"
Sep 17 09:50:20.088142 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:20.087499    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Sep 17 09:50:20.088287 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:20.087499    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused"
Sep 17 09:50:20.088287 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:20.087532    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Sep 17 09:50:22.087569 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:22.087516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:22.087968 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:22.087594    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:22.087968 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:22.087615    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:22.087968 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:22.087634    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.088894 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.088866    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.089280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.088960    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.089280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.089218    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.089805 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.089781    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.090064 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.089903    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.090064 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.090058    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:23.093938 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:23.093921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:24.089415 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:24.089386    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:50:28.650980 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:28.650935    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused"
Sep 17 09:50:28.651527 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:28.651080    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:50:28.749514 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:28.749472    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused"
Sep 17 09:50:28.749718 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:28.749586    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:50:31.916867 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:31.916840    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:50:32.018926 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.018895    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-feast-data\") pod \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") "
Sep 17 09:50:32.019116 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.018953    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls\") pod \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") "
Sep 17 09:50:32.019116 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.018993    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls\") pod \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") "
Sep 17 09:50:32.019116 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.019099    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fq68\" (UniqueName: \"kubernetes.io/projected/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-kube-api-access-9fq68\") pod \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") "
Sep 17 09:50:32.019318 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.019145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-registry-tls\") pod \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") "
Sep 17 09:50:32.019318 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.019207    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-online-tls\") pod \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\" (UID: \"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0\") "
Sep 17 09:50:32.019533 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.019504    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-feast-data" (OuterVolumeSpecName: "feast-data") pod "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:50:32.021304 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.021276    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:50:32.021464 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.021424    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-online-tls" (OuterVolumeSpecName: "online-tls") pod "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:50:32.021533 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.021465    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-kube-api-access-9fq68" (OuterVolumeSpecName: "kube-api-access-9fq68") pod "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0"). InnerVolumeSpecName "kube-api-access-9fq68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:50:32.021533 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.021499    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:50:32.021605 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.021590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" (UID: "8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:50:32.117724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117638    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerID="042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b" exitCode=137
Sep 17 09:50:32.117724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117672    2558 generic.go:356] "Generic (PLEG): container finished" podID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerID="a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205" exitCode=137
Sep 17 09:50:32.117724 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117707    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"
Sep 17 09:50:32.117966 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117718    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"}
Sep 17 09:50:32.117966 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117768    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"}
Sep 17 09:50:32.117966 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd" event={"ID":"8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0","Type":"ContainerDied","Data":"f06ed2b7db2913d1d33b672f0474eed7fa2ef8eaf7b4fc0fd0f21801b38c4bf5"}
Sep 17 09:50:32.117966 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.117803    2558 scope.go:117] "RemoveContainer" containerID="d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"
Sep 17 09:50:32.119887 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.119866    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:50:32.119887 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.119888    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:50:32.120086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.119896    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:50:32.120086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.119905    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fq68\" (UniqueName: \"kubernetes.io/projected/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-kube-api-access-9fq68\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:50:32.120086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.119922    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:50:32.120086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.119933    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:50:32.129376 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.129356    2558 scope.go:117] "RemoveContainer" containerID="042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"
Sep 17 09:50:32.136599 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.136578    2558 scope.go:117] "RemoveContainer" containerID="a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"
Sep 17 09:50:32.143522 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.143504    2558 scope.go:117] "RemoveContainer" containerID="a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"
Sep 17 09:50:32.149438 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.149411    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"]
Sep 17 09:50:32.150935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.150918    2558 scope.go:117] "RemoveContainer" containerID="ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"
Sep 17 09:50:32.156410 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.156378    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-k2zqd"]
Sep 17 09:50:32.158230 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.158215    2558 scope.go:117] "RemoveContainer" containerID="5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"
Sep 17 09:50:32.165201 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165156    2558 scope.go:117] "RemoveContainer" containerID="d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"
Sep 17 09:50:32.165498 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:50:32.165472    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb\": container with ID starting with d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb not found: ID does not exist" containerID="d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"
Sep 17 09:50:32.165555 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165501    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"} err="failed to get container status \"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb\": rpc error: code = NotFound desc = could not find container \"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb\": container with ID starting with d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb not found: ID does not exist"
Sep 17 09:50:32.165555 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165520    2558 scope.go:117] "RemoveContainer" containerID="042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"
Sep 17 09:50:32.165756 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:50:32.165742    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b\": container with ID starting with 042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b not found: ID does not exist" containerID="042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"
Sep 17 09:50:32.165794 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165759    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"} err="failed to get container status \"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b\": rpc error: code = NotFound desc = could not find container \"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b\": container with ID starting with 042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b not found: ID does not exist"
Sep 17 09:50:32.165794 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165771    2558 scope.go:117] "RemoveContainer" containerID="a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"
Sep 17 09:50:32.165975 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:50:32.165957    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c\": container with ID starting with a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c not found: ID does not exist" containerID="a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"
Sep 17 09:50:32.166099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165974    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"} err="failed to get container status \"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c\": rpc error: code = NotFound desc = could not find container \"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c\": container with ID starting with a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c not found: ID does not exist"
Sep 17 09:50:32.166099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.165985    2558 scope.go:117] "RemoveContainer" containerID="a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"
Sep 17 09:50:32.166242 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:50:32.166227    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205\": container with ID starting with a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205 not found: ID does not exist" containerID="a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"
Sep 17 09:50:32.166284 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166244    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"} err="failed to get container status \"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205\": rpc error: code = NotFound desc = could not find container \"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205\": container with ID starting with a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205 not found: ID does not exist"
Sep 17 09:50:32.166284 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166259    2558 scope.go:117] "RemoveContainer" containerID="ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"
Sep 17 09:50:32.166467 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:50:32.166453    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d\": container with ID starting with ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d not found: ID does not exist" containerID="ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"
Sep 17 09:50:32.166499 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166468    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"} err="failed to get container status \"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d\": rpc error: code = NotFound desc = could not find container \"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d\": container with ID starting with ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d not found: ID does not exist"
Sep 17 09:50:32.166499 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166482    2558 scope.go:117] "RemoveContainer" containerID="5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"
Sep 17 09:50:32.166699 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:50:32.166686    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea\": container with ID starting with 5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea not found: ID does not exist" containerID="5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"
Sep 17 09:50:32.166735 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166701    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"} err="failed to get container status \"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea\": rpc error: code = NotFound desc = could not find container \"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea\": container with ID starting with 5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea not found: ID does not exist"
Sep 17 09:50:32.166735 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166711    2558 scope.go:117] "RemoveContainer" containerID="d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"
Sep 17 09:50:32.166904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166886    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb"} err="failed to get container status \"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb\": rpc error: code = NotFound desc = could not find container \"d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb\": container with ID starting with d2ed6b94ec1a50b6cb612d9263b23eb43ad30221d2e068f314147c4433709efb not found: ID does not exist"
Sep 17 09:50:32.166942 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.166905    2558 scope.go:117] "RemoveContainer" containerID="042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"
Sep 17 09:50:32.167121 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167095    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b"} err="failed to get container status \"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b\": rpc error: code = NotFound desc = could not find container \"042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b\": container with ID starting with 042c286648fcef1cddd5068dcfd7d211c83980fce495262f60319132ce65b34b not found: ID does not exist"
Sep 17 09:50:32.167217 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167122    2558 scope.go:117] "RemoveContainer" containerID="a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"
Sep 17 09:50:32.167365 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167344    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c"} err="failed to get container status \"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c\": rpc error: code = NotFound desc = could not find container \"a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c\": container with ID starting with a2bf340da80dfc4d30978b82e17dba4d603235889574bf326b229b61e417958c not found: ID does not exist"
Sep 17 09:50:32.167428 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167366    2558 scope.go:117] "RemoveContainer" containerID="a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"
Sep 17 09:50:32.167603 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167586    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205"} err="failed to get container status \"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205\": rpc error: code = NotFound desc = could not find container \"a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205\": container with ID starting with a137a47f85a65aada30a35975d602edbd2c28bf0059d59435db6e2db4110d205 not found: ID does not exist"
Sep 17 09:50:32.167643 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167604    2558 scope.go:117] "RemoveContainer" containerID="ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"
Sep 17 09:50:32.167831 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167812    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d"} err="failed to get container status \"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d\": rpc error: code = NotFound desc = could not find container \"ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d\": container with ID starting with ac87bfba29466d9db941de43137ae69085091f7d3f22c6ce1ec47c19d2a7192d not found: ID does not exist"
Sep 17 09:50:32.167882 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.167833    2558 scope.go:117] "RemoveContainer" containerID="5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"
Sep 17 09:50:32.168056 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:32.168035    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea"} err="failed to get container status \"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea\": rpc error: code = NotFound desc = could not find container \"5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea\": container with ID starting with 5d0852d497121b977448a9a9663be1b806bfba5a23c96dda53f8e6184b6762ea not found: ID does not exist"
Sep 17 09:50:33.459337 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:50:33.459309    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" path="/var/lib/kubelet/pods/8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0/volumes"
Sep 17 09:51:26.877689 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877651    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"]
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877886    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="offline"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877896    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="offline"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877906    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="feast-apply"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877911    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="feast-apply"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877924    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="feast-init"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877930    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="feast-init"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877936    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877942    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877951    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="registry"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877956    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="registry"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877961    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.877966    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.878005    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="online"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.878013    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="ui"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.878019    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="registry"
Sep 17 09:51:26.878180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.878025    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a2e3d5e-f203-4824-a9c3-7f9fb0bd4ab0" containerName="offline"
Sep 17 09:51:26.880975 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.880957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.894051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.894026    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 09:51:26.894051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.894036    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 09:51:26.894241 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.894061    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 09:51:26.895327 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.895310    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 09:51:26.895408 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.895312    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 09:51:26.895465 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.895316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 09:51:26.901835 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.901818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e3873000-9fdd-4345-85eb-1157b949886d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.901887 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.901844    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.901887 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.901870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.901957 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.901887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.901992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.901966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e3873000-9fdd-4345-85eb-1157b949886d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.901992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.901987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdb8c\" (UniqueName: \"kubernetes.io/projected/e3873000-9fdd-4345-85eb-1157b949886d-kube-api-access-zdb8c\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:26.916971 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.916951    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-bgncj\""
Sep 17 09:51:26.994019 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:26.993988    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"]
Sep 17 09:51:27.003332 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003307    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e3873000-9fdd-4345-85eb-1157b949886d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.003456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003340    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdb8c\" (UniqueName: \"kubernetes.io/projected/e3873000-9fdd-4345-85eb-1157b949886d-kube-api-access-zdb8c\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.003456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e3873000-9fdd-4345-85eb-1157b949886d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.003456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.003456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.003456 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.003727 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:51:27.003536    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 17 09:51:27.003727 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:51:27.003554    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 17 09:51:27.003727 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:51:27.003598    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls podName:e3873000-9fdd-4345-85eb-1157b949886d nodeName:}" failed. No retries permitted until 2026-09-17 09:51:27.503579544 +0000 UTC m=+1292.569791287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" (UID: "e3873000-9fdd-4345-85eb-1157b949886d") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 17 09:51:27.003727 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:51:27.003624    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls podName:e3873000-9fdd-4345-85eb-1157b949886d nodeName:}" failed. No retries permitted until 2026-09-17 09:51:27.50360503 +0000 UTC m=+1292.569816787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" (UID: "e3873000-9fdd-4345-85eb-1157b949886d") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Sep 17 09:51:27.003890 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.003733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e3873000-9fdd-4345-85eb-1157b949886d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.004022 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.004005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e3873000-9fdd-4345-85eb-1157b949886d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.005949 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.005931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.015257 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.015233    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdb8c\" (UniqueName: \"kubernetes.io/projected/e3873000-9fdd-4345-85eb-1157b949886d-kube-api-access-zdb8c\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.507505 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.507476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.507505 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.507509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.509906 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.509886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.510067 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.510045    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5cwd2\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:27.791997 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:27.791902    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:51:28.074310 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:28.074234    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"]
Sep 17 09:51:28.077731 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:51:28.077703    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3873000_9fdd_4345_85eb_1157b949886d.slice/crio-94a8122fc7c7ae282b3440587e622ac7a81cada7acbc20a8ba4d7983857df7fe WatchSource:0}: Error finding container 94a8122fc7c7ae282b3440587e622ac7a81cada7acbc20a8ba4d7983857df7fe: Status 404 returned error can't find the container with id 94a8122fc7c7ae282b3440587e622ac7a81cada7acbc20a8ba4d7983857df7fe
Sep 17 09:51:28.320246 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:28.320204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerStarted","Data":"244107ce9651ddaabab7ad151f868c16226bd99a708a4749340f75476883c971"}
Sep 17 09:51:28.320445 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:28.320263    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerStarted","Data":"94a8122fc7c7ae282b3440587e622ac7a81cada7acbc20a8ba4d7983857df7fe"}
Sep 17 09:51:33.339037 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:33.339003    2558 generic.go:356] "Generic (PLEG): container finished" podID="e3873000-9fdd-4345-85eb-1157b949886d" containerID="244107ce9651ddaabab7ad151f868c16226bd99a708a4749340f75476883c971" exitCode=0
Sep 17 09:51:33.339439 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:33.339062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerDied","Data":"244107ce9651ddaabab7ad151f868c16226bd99a708a4749340f75476883c971"}
Sep 17 09:51:34.345909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:51:34.345876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerStarted","Data":"4ba08cc2310bab677bf7ab58767fa5b678757da83a1ccf59daf8689bc6173a0d"}
Sep 17 09:52:01.447558 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:01.447524    2558 generic.go:356] "Generic (PLEG): container finished" podID="e3873000-9fdd-4345-85eb-1157b949886d" containerID="4ba08cc2310bab677bf7ab58767fa5b678757da83a1ccf59daf8689bc6173a0d" exitCode=0
Sep 17 09:52:01.447984 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:01.447586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerDied","Data":"4ba08cc2310bab677bf7ab58767fa5b678757da83a1ccf59daf8689bc6173a0d"}
Sep 17 09:52:02.455256 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:02.455215    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerStarted","Data":"71204582c03454f8b2dc45489421277ad2559220fcdd631deecc06db49bad6b3"}
Sep 17 09:52:02.455670 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:02.455277    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerStarted","Data":"5e849b42689ad259c2bd254f7a16c68a08b1984c4b781e4935a85330a55ad87f"}
Sep 17 09:52:02.455670 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:02.455296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerStarted","Data":"87cdbdf5038765250e618a8a9593a40c69011d28144adf5ddeb17cda4b3d6f5f"}
Sep 17 09:52:02.488053 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:02.487990    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podStartSLOduration=36.487973053 podStartE2EDuration="36.487973053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:52:02.484957648 +0000 UTC m=+1327.551169412" watchObservedRunningTime="2026-09-17 09:52:02.487973053 +0000 UTC m=+1327.554184818"
Sep 17 09:52:03.792380 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:03.792341    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:03.792962 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:03.792936    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:03.793097 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:03.792973    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:03.794182 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:03.794129    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Sep 17 09:52:03.794302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:03.794206    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 17 09:52:03.794302 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:03.794129    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 17 09:52:06.792413 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:06.792363    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused"
Sep 17 09:52:06.792413 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:06.792397    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 17 09:52:06.792984 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:06.792391    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 17 09:52:07.792229 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:07.792182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:07.792446 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:07.792246    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:07.792446 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:07.792265    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:09.792781 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:09.792733    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 17 09:52:09.793431 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:09.793403    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:09.793565 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:09.793536    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:09.794290 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:09.794269    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:09.794377 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:09.794321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:13.796319 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:13.796276    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:52:16.797326 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:16.797283    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:52:19.674601 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:19.674516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:20.496979 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:20.496948    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:52:40.680293 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:52:40.680250    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:53:23.438730 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.438695    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"]
Sep 17 09:53:23.439295 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.438952    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" containerID="cri-o://87cdbdf5038765250e618a8a9593a40c69011d28144adf5ddeb17cda4b3d6f5f" gracePeriod=30
Sep 17 09:53:23.439295 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.438992    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="offline" containerID="cri-o://5e849b42689ad259c2bd254f7a16c68a08b1984c4b781e4935a85330a55ad87f" gracePeriod=30
Sep 17 09:53:23.439295 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.438994    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui" containerID="cri-o://71204582c03454f8b2dc45489421277ad2559220fcdd631deecc06db49bad6b3" gracePeriod=30
Sep 17 09:53:23.666560 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.666520    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"]
Sep 17 09:53:23.666867 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.666812    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="registry" containerID="cri-o://e49a1e1d4091ace39115b2c2ec54b11e935eb5197d3cbd8d791c8bb240377ba4" gracePeriod=30
Sep 17 09:53:23.667038 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.666857    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui" containerID="cri-o://b08ac4f3b5e0b9b8b8c902cce1f59c2e938c9b5612606139118debe3f7475042" gracePeriod=30
Sep 17 09:53:23.667131 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.666848    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="offline" containerID="cri-o://8dfcbd6bb202c433f2b8bf92c15703faf2585dbb4ce219a119dbdcbf9ed5960f" gracePeriod=30
Sep 17 09:53:23.667281 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:23.666866    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" containerID="cri-o://f4dc30c3da91707eea7ac997dc3fc55771d128a811a2a12c9d43a8016404c585" gracePeriod=30
Sep 17 09:53:24.087079 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.087031    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Sep 17 09:53:24.754593 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.754561    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerID="b08ac4f3b5e0b9b8b8c902cce1f59c2e938c9b5612606139118debe3f7475042" exitCode=0
Sep 17 09:53:24.754593 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.754586    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerID="f4dc30c3da91707eea7ac997dc3fc55771d128a811a2a12c9d43a8016404c585" exitCode=0
Sep 17 09:53:24.755052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.754635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"b08ac4f3b5e0b9b8b8c902cce1f59c2e938c9b5612606139118debe3f7475042"}
Sep 17 09:53:24.755052 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.754674    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"f4dc30c3da91707eea7ac997dc3fc55771d128a811a2a12c9d43a8016404c585"}
Sep 17 09:53:24.757043 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.757024    2558 generic.go:356] "Generic (PLEG): container finished" podID="e3873000-9fdd-4345-85eb-1157b949886d" containerID="71204582c03454f8b2dc45489421277ad2559220fcdd631deecc06db49bad6b3" exitCode=0
Sep 17 09:53:24.757043 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.757042    2558 generic.go:356] "Generic (PLEG): container finished" podID="e3873000-9fdd-4345-85eb-1157b949886d" containerID="87cdbdf5038765250e618a8a9593a40c69011d28144adf5ddeb17cda4b3d6f5f" exitCode=0
Sep 17 09:53:24.757137 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.757091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerDied","Data":"71204582c03454f8b2dc45489421277ad2559220fcdd631deecc06db49bad6b3"}
Sep 17 09:53:24.757137 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:24.757124    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerDied","Data":"87cdbdf5038765250e618a8a9593a40c69011d28144adf5ddeb17cda4b3d6f5f"}
Sep 17 09:53:29.676041 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:29.676002    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 17 09:53:29.794182 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:29.794136    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 17 09:53:33.089981 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:33.089935    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Sep 17 09:53:34.086853 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:34.086813    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Sep 17 09:53:39.675430 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:39.675387    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 17 09:53:39.794618 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:39.794561    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 17 09:53:43.090594 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:43.090548    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Sep 17 09:53:44.087389 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:44.087346    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Sep 17 09:53:44.087572 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:44.087471    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:53:49.675659 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:49.675615    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused"
Sep 17 09:53:49.676142 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:49.675751    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:53:49.794662 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:49.794614    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused"
Sep 17 09:53:49.794841 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:49.794741    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:53:53.089743 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.089699    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused"
Sep 17 09:53:53.090260 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.089851    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:53:53.856099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.856066    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerID="8dfcbd6bb202c433f2b8bf92c15703faf2585dbb4ce219a119dbdcbf9ed5960f" exitCode=137
Sep 17 09:53:53.856099 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.856091    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerID="e49a1e1d4091ace39115b2c2ec54b11e935eb5197d3cbd8d791c8bb240377ba4" exitCode=137
Sep 17 09:53:53.856336 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.856144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"8dfcbd6bb202c433f2b8bf92c15703faf2585dbb4ce219a119dbdcbf9ed5960f"}
Sep 17 09:53:53.856336 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.856210    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"e49a1e1d4091ace39115b2c2ec54b11e935eb5197d3cbd8d791c8bb240377ba4"}
Sep 17 09:53:53.863510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.863486    2558 generic.go:356] "Generic (PLEG): container finished" podID="e3873000-9fdd-4345-85eb-1157b949886d" containerID="5e849b42689ad259c2bd254f7a16c68a08b1984c4b781e4935a85330a55ad87f" exitCode=137
Sep 17 09:53:53.863638 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:53.863543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerDied","Data":"5e849b42689ad259c2bd254f7a16c68a08b1984c4b781e4935a85330a55ad87f"}
Sep 17 09:53:54.086592 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.086569    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:53:54.086744 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.086716    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused"
Sep 17 09:53:54.200348 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200319    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e3873000-9fdd-4345-85eb-1157b949886d-feast-data\") pod \"e3873000-9fdd-4345-85eb-1157b949886d\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") "
Sep 17 09:53:54.200754 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200373    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdb8c\" (UniqueName: \"kubernetes.io/projected/e3873000-9fdd-4345-85eb-1157b949886d-kube-api-access-zdb8c\") pod \"e3873000-9fdd-4345-85eb-1157b949886d\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") "
Sep 17 09:53:54.200754 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200420    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e3873000-9fdd-4345-85eb-1157b949886d-registry-tls\") pod \"e3873000-9fdd-4345-85eb-1157b949886d\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") "
Sep 17 09:53:54.200754 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200449    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls\") pod \"e3873000-9fdd-4345-85eb-1157b949886d\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") "
Sep 17 09:53:54.200754 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200475    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls\") pod \"e3873000-9fdd-4345-85eb-1157b949886d\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") "
Sep 17 09:53:54.200754 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200505    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-online-tls\") pod \"e3873000-9fdd-4345-85eb-1157b949886d\" (UID: \"e3873000-9fdd-4345-85eb-1157b949886d\") "
Sep 17 09:53:54.201017 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200824    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3873000-9fdd-4345-85eb-1157b949886d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e3873000-9fdd-4345-85eb-1157b949886d" (UID: "e3873000-9fdd-4345-85eb-1157b949886d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:53:54.201017 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.200970    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3873000-9fdd-4345-85eb-1157b949886d-feast-data" (OuterVolumeSpecName: "feast-data") pod "e3873000-9fdd-4345-85eb-1157b949886d" (UID: "e3873000-9fdd-4345-85eb-1157b949886d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:53:54.202673 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.202648    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e3873000-9fdd-4345-85eb-1157b949886d" (UID: "e3873000-9fdd-4345-85eb-1157b949886d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.203033 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.203011    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3873000-9fdd-4345-85eb-1157b949886d-kube-api-access-zdb8c" (OuterVolumeSpecName: "kube-api-access-zdb8c") pod "e3873000-9fdd-4345-85eb-1157b949886d" (UID: "e3873000-9fdd-4345-85eb-1157b949886d"). InnerVolumeSpecName "kube-api-access-zdb8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:53:54.203089 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.203028    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-online-tls" (OuterVolumeSpecName: "online-tls") pod "e3873000-9fdd-4345-85eb-1157b949886d" (UID: "e3873000-9fdd-4345-85eb-1157b949886d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.203089 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.203004    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e3873000-9fdd-4345-85eb-1157b949886d" (UID: "e3873000-9fdd-4345-85eb-1157b949886d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.299774 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.299743    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:53:54.301710 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.301691    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdb8c\" (UniqueName: \"kubernetes.io/projected/e3873000-9fdd-4345-85eb-1157b949886d-kube-api-access-zdb8c\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.301808 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.301716    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e3873000-9fdd-4345-85eb-1157b949886d-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.301808 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.301731    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.301808 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.301742    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.301808 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.301780    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e3873000-9fdd-4345-85eb-1157b949886d-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.301808 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.301792    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e3873000-9fdd-4345-85eb-1157b949886d-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.402570 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.402540    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-ui-tls\") pod \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") "
Sep 17 09:53:54.402734 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.402605    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-feast-data\") pod \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") "
Sep 17 09:53:54.402734 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.402628    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-offline-tls\") pod \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") "
Sep 17 09:53:54.402734 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.402656    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-registry-tls\") pod \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") "
Sep 17 09:53:54.402734 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.402709    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-online-tls\") pod \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") "
Sep 17 09:53:54.402937 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.402738    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltx96\" (UniqueName: \"kubernetes.io/projected/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-kube-api-access-ltx96\") pod \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\" (UID: \"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6\") "
Sep 17 09:53:54.403226 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.403195    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-feast-data" (OuterVolumeSpecName: "feast-data") pod "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" (UID: "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:53:54.404718 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.404696    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" (UID: "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.405080 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.405060    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" (UID: "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.405149 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.405105    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" (UID: "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.405240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.405220    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-online-tls" (OuterVolumeSpecName: "online-tls") pod "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" (UID: "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:53:54.405280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.405226    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-kube-api-access-ltx96" (OuterVolumeSpecName: "kube-api-access-ltx96") pod "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" (UID: "1f8f262e-a3fe-4d48-b513-c7cbb2b991a6"). InnerVolumeSpecName "kube-api-access-ltx96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:53:54.503783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.503729    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.503783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.503750    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.503783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.503759    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltx96\" (UniqueName: \"kubernetes.io/projected/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-kube-api-access-ltx96\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.503783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.503768    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.503783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.503776    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.503783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.503784    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:53:54.870091 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.869998    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"
Sep 17 09:53:54.870282 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.869987    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9" event={"ID":"1f8f262e-a3fe-4d48-b513-c7cbb2b991a6","Type":"ContainerDied","Data":"a4aa143fa10297761107f961b867260cad174a9d32a79d6bf935ee6b4143a945"}
Sep 17 09:53:54.870282 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.870147    2558 scope.go:117] "RemoveContainer" containerID="b08ac4f3b5e0b9b8b8c902cce1f59c2e938c9b5612606139118debe3f7475042"
Sep 17 09:53:54.873075 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.873023    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2" event={"ID":"e3873000-9fdd-4345-85eb-1157b949886d","Type":"ContainerDied","Data":"94a8122fc7c7ae282b3440587e622ac7a81cada7acbc20a8ba4d7983857df7fe"}
Sep 17 09:53:54.873075 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.873054    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"
Sep 17 09:53:54.879701 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.879682    2558 scope.go:117] "RemoveContainer" containerID="8dfcbd6bb202c433f2b8bf92c15703faf2585dbb4ce219a119dbdcbf9ed5960f"
Sep 17 09:53:54.886786 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.886766    2558 scope.go:117] "RemoveContainer" containerID="f4dc30c3da91707eea7ac997dc3fc55771d128a811a2a12c9d43a8016404c585"
Sep 17 09:53:54.893477 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.893461    2558 scope.go:117] "RemoveContainer" containerID="e49a1e1d4091ace39115b2c2ec54b11e935eb5197d3cbd8d791c8bb240377ba4"
Sep 17 09:53:54.897066 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.897045    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"]
Sep 17 09:53:54.900805 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.900780    2558 scope.go:117] "RemoveContainer" containerID="bb3cea789e9e11c37ef89f54ee14c53482cf1a1ed157f5d2f6efad85d1004eb0"
Sep 17 09:53:54.901535 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.901514    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-4n4z9"]
Sep 17 09:53:54.907686 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.907667    2558 scope.go:117] "RemoveContainer" containerID="83cbcd9a12909263abf6657c0017f3132b081152bd4fb835a06b09ec4ae39727"
Sep 17 09:53:54.915440 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.915400    2558 scope.go:117] "RemoveContainer" containerID="71204582c03454f8b2dc45489421277ad2559220fcdd631deecc06db49bad6b3"
Sep 17 09:53:54.916021 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.915998    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"]
Sep 17 09:53:54.922582 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.922563    2558 scope.go:117] "RemoveContainer" containerID="5e849b42689ad259c2bd254f7a16c68a08b1984c4b781e4935a85330a55ad87f"
Sep 17 09:53:54.923604 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.923586    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5cwd2"]
Sep 17 09:53:54.929667 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.929650    2558 scope.go:117] "RemoveContainer" containerID="87cdbdf5038765250e618a8a9593a40c69011d28144adf5ddeb17cda4b3d6f5f"
Sep 17 09:53:54.937546 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.937531    2558 scope.go:117] "RemoveContainer" containerID="4ba08cc2310bab677bf7ab58767fa5b678757da83a1ccf59daf8689bc6173a0d"
Sep 17 09:53:54.944895 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:54.944880    2558 scope.go:117] "RemoveContainer" containerID="244107ce9651ddaabab7ad151f868c16226bd99a708a4749340f75476883c971"
Sep 17 09:53:55.459361 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:55.459325    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" path="/var/lib/kubelet/pods/1f8f262e-a3fe-4d48-b513-c7cbb2b991a6/volumes"
Sep 17 09:53:55.459931 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:53:55.459916    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3873000-9fdd-4345-85eb-1157b949886d" path="/var/lib/kubelet/pods/e3873000-9fdd-4345-85eb-1157b949886d/volumes"
Sep 17 09:54:18.614483 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614446    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"]
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614680    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="feast-apply"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614692    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="feast-apply"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614704    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614710    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614715    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614721    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614727    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="feast-init"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614732    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="feast-init"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614740    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="offline"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614745    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="offline"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614759    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="feast-init"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614764    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="feast-init"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614771    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614775    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614780    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="offline"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614786    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="offline"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614792    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="registry"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614797    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="registry"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614802    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="feast-apply"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614807    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="feast-apply"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614811    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614816    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614853    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="registry"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614859    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="online"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614864    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="offline"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614869    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f8f262e-a3fe-4d48-b513-c7cbb2b991a6" containerName="ui"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614875    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="online"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614880    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="ui"
Sep 17 09:54:18.614935 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.614885    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3873000-9fdd-4345-85eb-1157b949886d" containerName="offline"
Sep 17 09:54:18.617644 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.617628    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:18.620909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.620884    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 17 09:54:18.620909 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.620907    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 17 09:54:18.622189 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.622157    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-hclhw\""
Sep 17 09:54:18.632547 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.632528    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"]
Sep 17 09:54:18.663270 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.663246    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcg5w\" (UniqueName: \"kubernetes.io/projected/7a9301bf-72f9-4324-8eb9-c86e1dcf073d-kube-api-access-rcg5w\") pod \"feast-operator-controller-manager-689b877b4b-xg8nw\" (UID: \"7a9301bf-72f9-4324-8eb9-c86e1dcf073d\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:18.764074 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.764040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcg5w\" (UniqueName: \"kubernetes.io/projected/7a9301bf-72f9-4324-8eb9-c86e1dcf073d-kube-api-access-rcg5w\") pod \"feast-operator-controller-manager-689b877b4b-xg8nw\" (UID: \"7a9301bf-72f9-4324-8eb9-c86e1dcf073d\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:18.783120 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.783085    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcg5w\" (UniqueName: \"kubernetes.io/projected/7a9301bf-72f9-4324-8eb9-c86e1dcf073d-kube-api-access-rcg5w\") pod \"feast-operator-controller-manager-689b877b4b-xg8nw\" (UID: \"7a9301bf-72f9-4324-8eb9-c86e1dcf073d\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:18.926905 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:18.926825    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:19.197389 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:19.197258    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"]
Sep 17 09:54:19.199872 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:54:19.199846    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9301bf_72f9_4324_8eb9_c86e1dcf073d.slice/crio-70d8d8e97224b6118fe09e35c3c5f8601195328a6674d45997f99cadabd4f72f WatchSource:0}: Error finding container 70d8d8e97224b6118fe09e35c3c5f8601195328a6674d45997f99cadabd4f72f: Status 404 returned error can't find the container with id 70d8d8e97224b6118fe09e35c3c5f8601195328a6674d45997f99cadabd4f72f
Sep 17 09:54:19.201657 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:19.201643    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 09:54:19.956929 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:19.956889    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw" event={"ID":"7a9301bf-72f9-4324-8eb9-c86e1dcf073d","Type":"ContainerStarted","Data":"70d8d8e97224b6118fe09e35c3c5f8601195328a6674d45997f99cadabd4f72f"}
Sep 17 09:54:21.964817 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:21.964776    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw" event={"ID":"7a9301bf-72f9-4324-8eb9-c86e1dcf073d","Type":"ContainerStarted","Data":"e57b6264b72d67381b77cd4e184d12970a0c448bd63d97859d73eb04b3b354ab"}
Sep 17 09:54:21.965226 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:21.964882    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:21.984829 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:21.984783    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw" podStartSLOduration=1.878733423 podStartE2EDuration="3.984765975s" totalImagesPullingTime="2.106032552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:54:21.983809776 +0000 UTC m=+1467.050021541" watchObservedRunningTime="2026-09-17 09:54:21.984765975 +0000 UTC m=+1467.050977741"
Sep 17 09:54:32.970982 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:32.970949    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-xg8nw"
Sep 17 09:54:40.587865 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.587827    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"]
Sep 17 09:54:40.591180 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.591147    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.595253 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595221    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 09:54:40.595407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595386    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 09:54:40.595767 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595750    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 09:54:40.595960 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595751    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-f248c\""
Sep 17 09:54:40.595960 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595792    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 09:54:40.596126 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595801    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 09:54:40.596126 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.595833    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 09:54:40.610896 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.610877    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"]
Sep 17 09:54:40.705590 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.705565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc0cb95-de24-4b1f-b583-7de6496f8245-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.705725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.705619    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.705725 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.705711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.705816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.705759    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.705816 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.705806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggv27\" (UniqueName: \"kubernetes.io/projected/0bc0cb95-de24-4b1f-b583-7de6496f8245-kube-api-access-ggv27\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.705886 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.705842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807111 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807255 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggv27\" (UniqueName: \"kubernetes.io/projected/0bc0cb95-de24-4b1f-b583-7de6496f8245-kube-api-access-ggv27\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807255 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807140    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807429 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:54:40.807406    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 09:54:40.807492 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc0cb95-de24-4b1f-b583-7de6496f8245-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807492 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:54:40.807479    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls podName:0bc0cb95-de24-4b1f-b583-7de6496f8245 nodeName:}" failed. No retries permitted until 2026-09-17 09:54:41.307458053 +0000 UTC m=+1486.373669796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls") pod "feast-simple-feast-setup-57576b8fcf-d69kt" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 09:54:40.807608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807608 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.807711 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:54:40.807687    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 09:54:40.807769 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:54:40.807742    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls podName:0bc0cb95-de24-4b1f-b583-7de6496f8245 nodeName:}" failed. No retries permitted until 2026-09-17 09:54:41.307725796 +0000 UTC m=+1486.373937544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-d69kt" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 09:54:40.807826 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.807774    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc0cb95-de24-4b1f-b583-7de6496f8245-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.809748 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.809713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.809946 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.809927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:40.817716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:40.817695    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggv27\" (UniqueName: \"kubernetes.io/projected/0bc0cb95-de24-4b1f-b583-7de6496f8245-kube-api-access-ggv27\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:41.312034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:41.311992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:41.312208 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:41.312053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:41.314437 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:41.314408    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:41.314562 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:41.314447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d69kt\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:41.500941 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:41.500910    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:41.780610 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:41.780584    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"]
Sep 17 09:54:41.782654 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:54:41.782627    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bc0cb95_de24_4b1f_b583_7de6496f8245.slice/crio-5afda6eacbaf515a20d3d509eea104e21833740f0c8d825eb1a60ffd6ac2bc78 WatchSource:0}: Error finding container 5afda6eacbaf515a20d3d509eea104e21833740f0c8d825eb1a60ffd6ac2bc78: Status 404 returned error can't find the container with id 5afda6eacbaf515a20d3d509eea104e21833740f0c8d825eb1a60ffd6ac2bc78
Sep 17 09:54:42.033768 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:42.032983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"b342097c3cb3f795594029cfe854ebc3ce178af8b9c0124fc057365b900c902e"}
Sep 17 09:54:42.033768 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:42.033039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"5afda6eacbaf515a20d3d509eea104e21833740f0c8d825eb1a60ffd6ac2bc78"}
Sep 17 09:54:47.057347 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:47.057305    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerID="b342097c3cb3f795594029cfe854ebc3ce178af8b9c0124fc057365b900c902e" exitCode=0
Sep 17 09:54:47.057752 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:47.057343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"b342097c3cb3f795594029cfe854ebc3ce178af8b9c0124fc057365b900c902e"}
Sep 17 09:54:48.063482 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:48.063446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"98be84b01a8ce7f731caa51e94a88c1ec51358c32e11e21d9a12d10dd07e5e4c"}
Sep 17 09:54:53.082542 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:53.082456    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerID="98be84b01a8ce7f731caa51e94a88c1ec51358c32e11e21d9a12d10dd07e5e4c" exitCode=0
Sep 17 09:54:53.082542 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:53.082488    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"98be84b01a8ce7f731caa51e94a88c1ec51358c32e11e21d9a12d10dd07e5e4c"}
Sep 17 09:54:54.091663 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:54.091618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"581c00bc1636a36f455bcbee9f852b57e8361c565a36cb510e44f76f4b28cfc3"}
Sep 17 09:54:54.092156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:54.091687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"f7cfd51b3ddc3af15f912c215dbaa7e3f5078512c07d07ea700e441725ddbbe9"}
Sep 17 09:54:54.092156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:54.091711    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"ebe987c5d0257caf2b41bd938a91d1dcf47d58c2fa226a51cf6c4558fec2f78c"}
Sep 17 09:54:54.092156 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:54.091732    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerStarted","Data":"e106877c2148d3b415db622853d73cd41678ca93a1f1f508832c3d0ff27b6bdf"}
Sep 17 09:54:54.124837 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:54.124758    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podStartSLOduration=14.124736868 podStartE2EDuration="14.124736868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:54:54.123638402 +0000 UTC m=+1499.189850168" watchObservedRunningTime="2026-09-17 09:54:54.124736868 +0000 UTC m=+1499.190948637"
Sep 17 09:54:55.399583 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:55.399550    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:54:55.401570 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:55.401540    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:54:56.501857 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.501815    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:56.502375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.501879    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:56.502375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.501902    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:56.502375 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.501920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:54:56.503979 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.503942    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 17 09:54:56.504085 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.504002    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 17 09:54:56.504085 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.503960    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Sep 17 09:54:56.504265 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:56.503960    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 17 09:54:59.501510 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:59.501469    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused"
Sep 17 09:54:59.502127 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:59.501475    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused"
Sep 17 09:54:59.502251 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:59.501483    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 17 09:54:59.502251 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:54:59.501530    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 17 09:55:01.501890 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:01.501856    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:01.502280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:01.501914    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:01.502280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:01.501928    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:01.502280 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:01.501940    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.502379 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.502345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.502795 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.502500    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.502851 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.502828    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.503311 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.503291    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.503446 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.503355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.503446 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.503399    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:02.507677 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:02.507662    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:55:03.133949 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:55:03.133918    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:56:05.967651 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:05.967616    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"]
Sep 17 09:56:05.968224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:05.967911    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="registry" containerID="cri-o://e106877c2148d3b415db622853d73cd41678ca93a1f1f508832c3d0ff27b6bdf" gracePeriod=30
Sep 17 09:56:05.968224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:05.968016    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online" containerID="cri-o://ebe987c5d0257caf2b41bd938a91d1dcf47d58c2fa226a51cf6c4558fec2f78c" gracePeriod=30
Sep 17 09:56:05.968224 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:05.968069    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui" containerID="cri-o://581c00bc1636a36f455bcbee9f852b57e8361c565a36cb510e44f76f4b28cfc3" gracePeriod=30
Sep 17 09:56:05.968417 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:05.968262    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="offline" containerID="cri-o://f7cfd51b3ddc3af15f912c215dbaa7e3f5078512c07d07ea700e441725ddbbe9" gracePeriod=30
Sep 17 09:56:06.369470 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.369384    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"]
Sep 17 09:56:06.373418 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.373382    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.376943 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.376920    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ws25n\""
Sep 17 09:56:06.388997 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.388971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"]
Sep 17 09:56:06.416239 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.416188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fxjs\" (UniqueName: \"kubernetes.io/projected/9940ee5f-c763-46e7-a1b7-4867db1699ab-kube-api-access-9fxjs\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.416432 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.416300    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.416432 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.416331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.416432 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.416361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.416432 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.416390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.416640 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.416432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9940ee5f-c763-46e7-a1b7-4867db1699ab-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.516996 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.516952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fxjs\" (UniqueName: \"kubernetes.io/projected/9940ee5f-c763-46e7-a1b7-4867db1699ab-kube-api-access-9fxjs\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.517054    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.517085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.517111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.517135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517212 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.517189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9940ee5f-c763-46e7-a1b7-4867db1699ab-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517611 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.517588    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9940ee5f-c763-46e7-a1b7-4867db1699ab-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.517687 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:56:06.517593    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 09:56:06.517743 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:56:06.517730    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls podName:9940ee5f-c763-46e7-a1b7-4867db1699ab nodeName:}" failed. No retries permitted until 2026-09-17 09:56:07.017708647 +0000 UTC m=+1572.083920395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-b22hg" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 17 09:56:06.519992 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.519960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.520354 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.520334    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.520777 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.520755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:06.529450 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:06.529424    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fxjs\" (UniqueName: \"kubernetes.io/projected/9940ee5f-c763-46e7-a1b7-4867db1699ab-kube-api-access-9fxjs\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:07.022172 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.022123    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:07.024541 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.024514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b22hg\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:07.285021 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.284923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:07.358568 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.358538    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerID="581c00bc1636a36f455bcbee9f852b57e8361c565a36cb510e44f76f4b28cfc3" exitCode=0
Sep 17 09:56:07.358568 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.358563    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerID="ebe987c5d0257caf2b41bd938a91d1dcf47d58c2fa226a51cf6c4558fec2f78c" exitCode=0
Sep 17 09:56:07.358756 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.358590    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"581c00bc1636a36f455bcbee9f852b57e8361c565a36cb510e44f76f4b28cfc3"}
Sep 17 09:56:07.358756 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.358618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"ebe987c5d0257caf2b41bd938a91d1dcf47d58c2fa226a51cf6c4558fec2f78c"}
Sep 17 09:56:07.569630 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:07.569602    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"]
Sep 17 09:56:07.572097 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:56:07.572069    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9940ee5f_c763_46e7_a1b7_4867db1699ab.slice/crio-15c506b80e67b9972b6a43dfd8057f19f775ce374d708919ed6d19bca978602f WatchSource:0}: Error finding container 15c506b80e67b9972b6a43dfd8057f19f775ce374d708919ed6d19bca978602f: Status 404 returned error can't find the container with id 15c506b80e67b9972b6a43dfd8057f19f775ce374d708919ed6d19bca978602f
Sep 17 09:56:08.364336 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:08.364291    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"}
Sep 17 09:56:08.364779 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:08.364344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"15c506b80e67b9972b6a43dfd8057f19f775ce374d708919ed6d19bca978602f"}
Sep 17 09:56:12.503732 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:12.503688    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 17 09:56:13.131461 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:13.131417    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 17 09:56:13.383710 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:13.383626    2558 generic.go:356] "Generic (PLEG): container finished" podID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerID="5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0" exitCode=0
Sep 17 09:56:13.383710 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:13.383696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"}
Sep 17 09:56:14.388850 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:14.388815    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"}
Sep 17 09:56:19.409563 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:19.409528    2558 generic.go:356] "Generic (PLEG): container finished" podID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerID="acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd" exitCode=0
Sep 17 09:56:19.409951 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:19.409572    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"}
Sep 17 09:56:20.423950 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:20.423898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"}
Sep 17 09:56:20.424487 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:20.423971    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"}
Sep 17 09:56:20.424487 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:20.423993    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"}
Sep 17 09:56:20.424487 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:20.424012    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerStarted","Data":"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"}
Sep 17 09:56:20.454350 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:20.454294    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podStartSLOduration=14.454274551 podStartE2EDuration="14.454274551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:56:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:56:20.453000288 +0000 UTC m=+1585.519212087" watchObservedRunningTime="2026-09-17 09:56:20.454274551 +0000 UTC m=+1585.520486319"
Sep 17 09:56:22.285542 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.285501    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:22.286108 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.286090    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:22.286241 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.286230    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:22.286605 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.286585    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:22.288073 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.288032    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 17 09:56:22.288222 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.288073    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 17 09:56:22.288222 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.288076    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 17 09:56:22.288222 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.288179    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 17 09:56:22.503317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:22.503274    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 17 09:56:23.131640 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:23.131590    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 17 09:56:25.285591 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:25.285541    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused"
Sep 17 09:56:25.286086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:25.285541    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.32:8816: connect: connection refused"
Sep 17 09:56:25.286086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:25.285545    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 17 09:56:25.286086 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:25.285559    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 17 09:56:27.286021 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:27.285981    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:27.286431 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:27.286043    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:27.286431 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:27.286063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:27.286431 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:27.286081    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.286209 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.286154    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.286663 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.286342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.286663 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.286520    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.291357 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.291319    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.462298 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.462267    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.462457 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.462421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.462457 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.462458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:28.464723 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:28.464709    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:56:32.503942 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:32.503895    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused"
Sep 17 09:56:32.504393 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:32.504041    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:56:33.131710 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:33.131668    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused"
Sep 17 09:56:33.131899 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:33.131784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:56:36.492026 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.492000    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerID="f7cfd51b3ddc3af15f912c215dbaa7e3f5078512c07d07ea700e441725ddbbe9" exitCode=137
Sep 17 09:56:36.492026 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.492023    2558 generic.go:356] "Generic (PLEG): container finished" podID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerID="e106877c2148d3b415db622853d73cd41678ca93a1f1f508832c3d0ff27b6bdf" exitCode=137
Sep 17 09:56:36.492404 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.492067    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"f7cfd51b3ddc3af15f912c215dbaa7e3f5078512c07d07ea700e441725ddbbe9"}
Sep 17 09:56:36.492404 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.492095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"e106877c2148d3b415db622853d73cd41678ca93a1f1f508832c3d0ff27b6bdf"}
Sep 17 09:56:36.612625 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.612601    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:56:36.749607 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.749525    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-offline-tls\") pod \"0bc0cb95-de24-4b1f-b583-7de6496f8245\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") "
Sep 17 09:56:36.749607 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.749568    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-registry-tls\") pod \"0bc0cb95-de24-4b1f-b583-7de6496f8245\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") "
Sep 17 09:56:36.749607 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.749593    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggv27\" (UniqueName: \"kubernetes.io/projected/0bc0cb95-de24-4b1f-b583-7de6496f8245-kube-api-access-ggv27\") pod \"0bc0cb95-de24-4b1f-b583-7de6496f8245\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") "
Sep 17 09:56:36.749854 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.749778    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls\") pod \"0bc0cb95-de24-4b1f-b583-7de6496f8245\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") "
Sep 17 09:56:36.749854 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.749828    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls\") pod \"0bc0cb95-de24-4b1f-b583-7de6496f8245\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") "
Sep 17 09:56:36.749938 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.749859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc0cb95-de24-4b1f-b583-7de6496f8245-feast-data\") pod \"0bc0cb95-de24-4b1f-b583-7de6496f8245\" (UID: \"0bc0cb95-de24-4b1f-b583-7de6496f8245\") "
Sep 17 09:56:36.750645 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.750610    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc0cb95-de24-4b1f-b583-7de6496f8245-feast-data" (OuterVolumeSpecName: "feast-data") pod "0bc0cb95-de24-4b1f-b583-7de6496f8245" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:56:36.751927 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.751900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls" (OuterVolumeSpecName: "online-tls") pod "0bc0cb95-de24-4b1f-b583-7de6496f8245" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:56:36.752060 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.751972    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0bc0cb95-de24-4b1f-b583-7de6496f8245" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:56:36.752123 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.752011    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc0cb95-de24-4b1f-b583-7de6496f8245-kube-api-access-ggv27" (OuterVolumeSpecName: "kube-api-access-ggv27") pod "0bc0cb95-de24-4b1f-b583-7de6496f8245" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245"). InnerVolumeSpecName "kube-api-access-ggv27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:56:36.752123 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.752096    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0bc0cb95-de24-4b1f-b583-7de6496f8245" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:56:36.752231 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.752127    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0bc0cb95-de24-4b1f-b583-7de6496f8245" (UID: "0bc0cb95-de24-4b1f-b583-7de6496f8245"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:56:36.850838 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.850816    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:56:36.850838 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.850836    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:56:36.850976 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.850846    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggv27\" (UniqueName: \"kubernetes.io/projected/0bc0cb95-de24-4b1f-b583-7de6496f8245-kube-api-access-ggv27\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:56:36.850976 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.850856    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:56:36.850976 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.850884    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0bc0cb95-de24-4b1f-b583-7de6496f8245-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:56:36.850976 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:36.850893    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0bc0cb95-de24-4b1f-b583-7de6496f8245-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:56:37.497840 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.497803    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt" event={"ID":"0bc0cb95-de24-4b1f-b583-7de6496f8245","Type":"ContainerDied","Data":"5afda6eacbaf515a20d3d509eea104e21833740f0c8d825eb1a60ffd6ac2bc78"}
Sep 17 09:56:37.497840 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.497827    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"
Sep 17 09:56:37.498243 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.497864    2558 scope.go:117] "RemoveContainer" containerID="581c00bc1636a36f455bcbee9f852b57e8361c565a36cb510e44f76f4b28cfc3"
Sep 17 09:56:37.505700 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.505684    2558 scope.go:117] "RemoveContainer" containerID="f7cfd51b3ddc3af15f912c215dbaa7e3f5078512c07d07ea700e441725ddbbe9"
Sep 17 09:56:37.512904 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.512881    2558 scope.go:117] "RemoveContainer" containerID="ebe987c5d0257caf2b41bd938a91d1dcf47d58c2fa226a51cf6c4558fec2f78c"
Sep 17 09:56:37.519917 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.519896    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"]
Sep 17 09:56:37.519978 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.519906    2558 scope.go:117] "RemoveContainer" containerID="e106877c2148d3b415db622853d73cd41678ca93a1f1f508832c3d0ff27b6bdf"
Sep 17 09:56:37.527080 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.527062    2558 scope.go:117] "RemoveContainer" containerID="98be84b01a8ce7f731caa51e94a88c1ec51358c32e11e21d9a12d10dd07e5e4c"
Sep 17 09:56:37.527364 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.527346    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d69kt"]
Sep 17 09:56:37.533573 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:37.533557    2558 scope.go:117] "RemoveContainer" containerID="b342097c3cb3f795594029cfe854ebc3ce178af8b9c0124fc057365b900c902e"
Sep 17 09:56:39.459894 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:56:39.459847    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" path="/var/lib/kubelet/pods/0bc0cb95-de24-4b1f-b583-7de6496f8245/volumes"
Sep 17 09:57:31.095353 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095316    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"]
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095575    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="feast-init"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095586    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="feast-init"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095594    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095599    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095610    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="registry"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095615    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="registry"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095623    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="feast-apply"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095628    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="feast-apply"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095639    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="offline"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095644    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="offline"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095651    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095656    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095694    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="offline"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095702    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="registry"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095708    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="online"
Sep 17 09:57:31.095939 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.095714    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc0cb95-de24-4b1f-b583-7de6496f8245" containerName="ui"
Sep 17 09:57:31.098836 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.098816    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.101842 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.101817    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 09:57:31.101987 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.101959    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 09:57:31.101987 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.101838    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 09:57:31.102195 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.101989    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 09:57:31.102364 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.102347    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 09:57:31.102427 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.102408    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-fttsv\""
Sep 17 09:57:31.103207 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.103189    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 09:57:31.115149 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.115128    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"]
Sep 17 09:57:31.123103 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.123083    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.123221 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.123112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84f58e93-4a77-4215-9c08-ea374f25c387-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.123221 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.123145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.123221 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.123205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk6tq\" (UniqueName: \"kubernetes.io/projected/84f58e93-4a77-4215-9c08-ea374f25c387-kube-api-access-jk6tq\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.123401 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.123242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.123401 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.123275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84f58e93-4a77-4215-9c08-ea374f25c387-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224148 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224112    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224148 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84f58e93-4a77-4215-9c08-ea374f25c387-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224383 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224202    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224383 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224218    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6tq\" (UniqueName: \"kubernetes.io/projected/84f58e93-4a77-4215-9c08-ea374f25c387-kube-api-access-jk6tq\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224383 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224383 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84f58e93-4a77-4215-9c08-ea374f25c387-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224600 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:57:31.224393    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 17 09:57:31.224600 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:57:31.224469    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls podName:84f58e93-4a77-4215-9c08-ea374f25c387 nodeName:}" failed. No retries permitted until 2026-09-17 09:57:31.724447856 +0000 UTC m=+1656.790659600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387") : secret "feast-simple-feast-remote-setup-online-tls" not found
Sep 17 09:57:31.224717 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224679    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84f58e93-4a77-4215-9c08-ea374f25c387-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.224934 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.224915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84f58e93-4a77-4215-9c08-ea374f25c387-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.226674 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.226653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.226768 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.226717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.234432 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.234414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk6tq\" (UniqueName: \"kubernetes.io/projected/84f58e93-4a77-4215-9c08-ea374f25c387-kube-api-access-jk6tq\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.729300 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.729266    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:31.731773 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:31.731747    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-v8kmz\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:32.008348 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:32.008267    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:57:32.292331 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:32.292304    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"]
Sep 17 09:57:32.293728 ip-10-0-135-161 kubenswrapper[2558]: W0917 09:57:32.293702    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84f58e93_4a77_4215_9c08_ea374f25c387.slice/crio-e8acd682fa02652d08379cf7575497256797317db3bb1d6dbb9e3ac31da2c037 WatchSource:0}: Error finding container e8acd682fa02652d08379cf7575497256797317db3bb1d6dbb9e3ac31da2c037: Status 404 returned error can't find the container with id e8acd682fa02652d08379cf7575497256797317db3bb1d6dbb9e3ac31da2c037
Sep 17 09:57:32.684214 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:32.684109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerStarted","Data":"f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54"}
Sep 17 09:57:32.684214 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:32.684185    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerStarted","Data":"e8acd682fa02652d08379cf7575497256797317db3bb1d6dbb9e3ac31da2c037"}
Sep 17 09:57:37.703060 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:37.703026    2558 generic.go:356] "Generic (PLEG): container finished" podID="84f58e93-4a77-4215-9c08-ea374f25c387" containerID="f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54" exitCode=0
Sep 17 09:57:37.703495 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:37.703068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerDied","Data":"f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54"}
Sep 17 09:57:38.708629 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:57:38.708594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerStarted","Data":"d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a"}
Sep 17 09:58:00.786413 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:00.786378    2558 generic.go:356] "Generic (PLEG): container finished" podID="84f58e93-4a77-4215-9c08-ea374f25c387" containerID="d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a" exitCode=0
Sep 17 09:58:00.786782 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:00.786450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerDied","Data":"d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a"}
Sep 17 09:58:01.794176 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:01.794109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerStarted","Data":"b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c"}
Sep 17 09:58:01.794686 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:01.794188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerStarted","Data":"579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b"}
Sep 17 09:58:01.794686 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:01.794214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerStarted","Data":"d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba"}
Sep 17 09:58:01.842471 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:01.842410    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podStartSLOduration=30.842390971 podStartE2EDuration="30.842390971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 09:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 09:58:01.841733899 +0000 UTC m=+1686.907945665" watchObservedRunningTime="2026-09-17 09:58:01.842390971 +0000 UTC m=+1686.908602735"
Sep 17 09:58:02.009122 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.008907    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:02.009122 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.008989    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:02.009122 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.009008    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:02.009122 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.009034    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:02.009122 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.009049    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:02.009122 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.009063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:02.010620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.010543    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 17 09:58:02.010620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.010577    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 17 09:58:02.010620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:02.010580    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 17 09:58:05.009220 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:05.009150    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 17 09:58:05.009220 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:05.009176    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 17 09:58:05.009220 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:05.009194    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 17 09:58:08.008971 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:08.008919    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.33:8816: connect: connection refused"
Sep 17 09:58:08.009499 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:08.008980    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 17 09:58:08.009499 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:08.008919    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 17 09:58:11.009716 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:11.009689    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:11.010106 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:11.009808    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:11.010348 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:11.010321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:11.010646 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:11.010626    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:11.739213 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:11.739177    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:12.673968 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:12.673938    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:58:13.013309 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:13.013267    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:58:33.012358 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:33.012262    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:58:53.014341 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:58:53.014294    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:59:12.851307 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:12.851256    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:59:13.009047 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:13.009005    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 17 09:59:15.225931 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.225897    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"]
Sep 17 09:59:15.226365 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.226112    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" containerID="cri-o://d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba" gracePeriod=30
Sep 17 09:59:15.226365 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.226153    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline" containerID="cri-o://579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b" gracePeriod=30
Sep 17 09:59:15.226365 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.226144    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" containerID="cri-o://b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c" gracePeriod=30
Sep 17 09:59:15.425229 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.425196    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"]
Sep 17 09:59:15.425428 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.425406    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="registry" containerID="cri-o://322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc" gracePeriod=30
Sep 17 09:59:15.425620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.425517    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="offline" containerID="cri-o://5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda" gracePeriod=30
Sep 17 09:59:15.425620 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.425537    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui" containerID="cri-o://97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc" gracePeriod=30
Sep 17 09:59:15.425900 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:15.425591    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online" containerID="cri-o://d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a" gracePeriod=30
Sep 17 09:59:16.078835 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:16.078796    2558 generic.go:356] "Generic (PLEG): container finished" podID="84f58e93-4a77-4215-9c08-ea374f25c387" containerID="b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c" exitCode=0
Sep 17 09:59:16.078991 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:16.078865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerDied","Data":"b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c"}
Sep 17 09:59:17.085363 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:17.085333    2558 generic.go:356] "Generic (PLEG): container finished" podID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerID="97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc" exitCode=0
Sep 17 09:59:17.085363 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:17.085357    2558 generic.go:356] "Generic (PLEG): container finished" podID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerID="d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a" exitCode=0
Sep 17 09:59:17.085843 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:17.085411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"}
Sep 17 09:59:17.085843 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:17.085461    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"}
Sep 17 09:59:17.087914 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:17.087877    2558 generic.go:356] "Generic (PLEG): container finished" podID="84f58e93-4a77-4215-9c08-ea374f25c387" containerID="d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba" exitCode=0
Sep 17 09:59:17.088025 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:17.087947    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerDied","Data":"d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba"}
Sep 17 09:59:18.462173 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:18.462112    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 17 09:59:18.462173 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:18.462142    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 17 09:59:21.010765 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:21.010727    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 17 09:59:21.847407 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:21.847366    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 17 09:59:28.461896 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:28.461850    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 17 09:59:28.461896 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:28.461890    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 17 09:59:31.010583 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:31.010537    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 17 09:59:31.847492 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:31.847453    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 17 09:59:31.847684 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:31.847584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:59:38.462575 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:38.462539    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused"
Sep 17 09:59:38.463029 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:38.462528    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.32:8443: connect: connection refused"
Sep 17 09:59:38.463029 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:38.462654    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:59:38.463029 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:38.462737    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:59:41.010492 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:41.010442    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.33:8443: connect: connection refused"
Sep 17 09:59:41.010898 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:41.010583    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:59:41.847842 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:41.847806    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online" probeResult="failure" output="Get \"https://10.132.0.33:6567/health\": dial tcp 10.132.0.33:6567: connect: connection refused"
Sep 17 09:59:45.866054 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:45.866027    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:59:46.034622 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.034546    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls\") pod \"84f58e93-4a77-4215-9c08-ea374f25c387\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") "
Sep 17 09:59:46.034622 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.034593    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84f58e93-4a77-4215-9c08-ea374f25c387-feast-data\") pod \"84f58e93-4a77-4215-9c08-ea374f25c387\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") "
Sep 17 09:59:46.034622 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.034615    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-ui-tls\") pod \"84f58e93-4a77-4215-9c08-ea374f25c387\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") "
Sep 17 09:59:46.034868 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.034638    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-offline-tls\") pod \"84f58e93-4a77-4215-9c08-ea374f25c387\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") "
Sep 17 09:59:46.034868 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.034758    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk6tq\" (UniqueName: \"kubernetes.io/projected/84f58e93-4a77-4215-9c08-ea374f25c387-kube-api-access-jk6tq\") pod \"84f58e93-4a77-4215-9c08-ea374f25c387\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") "
Sep 17 09:59:46.034868 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.034797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84f58e93-4a77-4215-9c08-ea374f25c387-registry-tls\") pod \"84f58e93-4a77-4215-9c08-ea374f25c387\" (UID: \"84f58e93-4a77-4215-9c08-ea374f25c387\") "
Sep 17 09:59:46.035337 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.035305    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84f58e93-4a77-4215-9c08-ea374f25c387-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "84f58e93-4a77-4215-9c08-ea374f25c387" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 09:59:46.035458 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.035376    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84f58e93-4a77-4215-9c08-ea374f25c387-feast-data" (OuterVolumeSpecName: "feast-data") pod "84f58e93-4a77-4215-9c08-ea374f25c387" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:59:46.036944 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.036899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "84f58e93-4a77-4215-9c08-ea374f25c387" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.037034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.036977    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls" (OuterVolumeSpecName: "online-tls") pod "84f58e93-4a77-4215-9c08-ea374f25c387" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.037034 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.036988    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84f58e93-4a77-4215-9c08-ea374f25c387-kube-api-access-jk6tq" (OuterVolumeSpecName: "kube-api-access-jk6tq") pod "84f58e93-4a77-4215-9c08-ea374f25c387" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387"). InnerVolumeSpecName "kube-api-access-jk6tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:59:46.037110 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.037059    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "84f58e93-4a77-4215-9c08-ea374f25c387" (UID: "84f58e93-4a77-4215-9c08-ea374f25c387"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.056354 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.056334    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:59:46.136208 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.136177    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk6tq\" (UniqueName: \"kubernetes.io/projected/84f58e93-4a77-4215-9c08-ea374f25c387-kube-api-access-jk6tq\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.136208 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.136204    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/84f58e93-4a77-4215-9c08-ea374f25c387-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.136208 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.136216    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.136406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.136224    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/84f58e93-4a77-4215-9c08-ea374f25c387-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.136406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.136232    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.136406 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.136239    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/84f58e93-4a77-4215-9c08-ea374f25c387-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.188986 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.188960    2558 generic.go:356] "Generic (PLEG): container finished" podID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerID="5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda" exitCode=137
Sep 17 09:59:46.188986 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.188981    2558 generic.go:356] "Generic (PLEG): container finished" podID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerID="322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc" exitCode=137
Sep 17 09:59:46.189240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.189019    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"
Sep 17 09:59:46.189240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.189052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"}
Sep 17 09:59:46.189240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.189100    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"}
Sep 17 09:59:46.189240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.189115    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg" event={"ID":"9940ee5f-c763-46e7-a1b7-4867db1699ab","Type":"ContainerDied","Data":"15c506b80e67b9972b6a43dfd8057f19f775ce374d708919ed6d19bca978602f"}
Sep 17 09:59:46.189240 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.189134    2558 scope.go:117] "RemoveContainer" containerID="97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"
Sep 17 09:59:46.191536 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.191514    2558 generic.go:356] "Generic (PLEG): container finished" podID="84f58e93-4a77-4215-9c08-ea374f25c387" containerID="579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b" exitCode=137
Sep 17 09:59:46.191621 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.191555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerDied","Data":"579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b"}
Sep 17 09:59:46.191621 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.191587    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz" event={"ID":"84f58e93-4a77-4215-9c08-ea374f25c387","Type":"ContainerDied","Data":"e8acd682fa02652d08379cf7575497256797317db3bb1d6dbb9e3ac31da2c037"}
Sep 17 09:59:46.191621 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.191593    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"
Sep 17 09:59:46.197036 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.197020    2558 scope.go:117] "RemoveContainer" containerID="5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"
Sep 17 09:59:46.204298 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.204278    2558 scope.go:117] "RemoveContainer" containerID="d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"
Sep 17 09:59:46.211126 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.211106    2558 scope.go:117] "RemoveContainer" containerID="322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"
Sep 17 09:59:46.217930 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.217908    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"]
Sep 17 09:59:46.218096 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.218084    2558 scope.go:117] "RemoveContainer" containerID="acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"
Sep 17 09:59:46.223241 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.223220    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-v8kmz"]
Sep 17 09:59:46.225547 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.225534    2558 scope.go:117] "RemoveContainer" containerID="5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"
Sep 17 09:59:46.232067 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.231882    2558 scope.go:117] "RemoveContainer" containerID="97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"
Sep 17 09:59:46.232185 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.232147    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc\": container with ID starting with 97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc not found: ID does not exist" containerID="97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"
Sep 17 09:59:46.232251 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232195    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"} err="failed to get container status \"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc\": rpc error: code = NotFound desc = could not find container \"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc\": container with ID starting with 97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc not found: ID does not exist"
Sep 17 09:59:46.232251 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232214    2558 scope.go:117] "RemoveContainer" containerID="5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"
Sep 17 09:59:46.232474 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.232454    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda\": container with ID starting with 5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda not found: ID does not exist" containerID="5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"
Sep 17 09:59:46.232537 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232488    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"} err="failed to get container status \"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda\": rpc error: code = NotFound desc = could not find container \"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda\": container with ID starting with 5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda not found: ID does not exist"
Sep 17 09:59:46.232537 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232504    2558 scope.go:117] "RemoveContainer" containerID="d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"
Sep 17 09:59:46.232737 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.232721    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a\": container with ID starting with d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a not found: ID does not exist" containerID="d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"
Sep 17 09:59:46.232793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232740    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"} err="failed to get container status \"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a\": rpc error: code = NotFound desc = could not find container \"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a\": container with ID starting with d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a not found: ID does not exist"
Sep 17 09:59:46.232793 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232752    2558 scope.go:117] "RemoveContainer" containerID="322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"
Sep 17 09:59:46.232980 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.232962    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc\": container with ID starting with 322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc not found: ID does not exist" containerID="322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"
Sep 17 09:59:46.233037 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.232984    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"} err="failed to get container status \"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc\": rpc error: code = NotFound desc = could not find container \"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc\": container with ID starting with 322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc not found: ID does not exist"
Sep 17 09:59:46.233037 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233005    2558 scope.go:117] "RemoveContainer" containerID="acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"
Sep 17 09:59:46.233275 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.233254    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd\": container with ID starting with acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd not found: ID does not exist" containerID="acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"
Sep 17 09:59:46.233339 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233280    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"} err="failed to get container status \"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd\": rpc error: code = NotFound desc = could not find container \"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd\": container with ID starting with acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd not found: ID does not exist"
Sep 17 09:59:46.233339 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233300    2558 scope.go:117] "RemoveContainer" containerID="5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"
Sep 17 09:59:46.233540 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.233525    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0\": container with ID starting with 5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0 not found: ID does not exist" containerID="5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"
Sep 17 09:59:46.233596 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233543    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"} err="failed to get container status \"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0\": rpc error: code = NotFound desc = could not find container \"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0\": container with ID starting with 5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0 not found: ID does not exist"
Sep 17 09:59:46.233596 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233555    2558 scope.go:117] "RemoveContainer" containerID="97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"
Sep 17 09:59:46.233783 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233765    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc"} err="failed to get container status \"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc\": rpc error: code = NotFound desc = could not find container \"97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc\": container with ID starting with 97ef0b9a79f1b853e9f0c6a9d5987f2d398f232e138fe5bd1ce75b8c16c1a5bc not found: ID does not exist"
Sep 17 09:59:46.233845 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.233784    2558 scope.go:117] "RemoveContainer" containerID="5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"
Sep 17 09:59:46.234039 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234019    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda"} err="failed to get container status \"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda\": rpc error: code = NotFound desc = could not find container \"5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda\": container with ID starting with 5b89a69a2961c156e7645ac49c6915ffc74b0098004204ad4e17243b03bc2bda not found: ID does not exist"
Sep 17 09:59:46.234039 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234038    2558 scope.go:117] "RemoveContainer" containerID="d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"
Sep 17 09:59:46.234309 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234293    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a"} err="failed to get container status \"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a\": rpc error: code = NotFound desc = could not find container \"d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a\": container with ID starting with d2af63bc388c5d87a411889e7d8f03c368a94bdfeca0a75ee17bc07e2b693b6a not found: ID does not exist"
Sep 17 09:59:46.234309 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234307    2558 scope.go:117] "RemoveContainer" containerID="322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"
Sep 17 09:59:46.234526 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234506    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc"} err="failed to get container status \"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc\": rpc error: code = NotFound desc = could not find container \"322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc\": container with ID starting with 322b682aac01148e3df1aa86bb6577ff766608ce254001fc93ba1ad643f862fc not found: ID does not exist"
Sep 17 09:59:46.234526 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234526    2558 scope.go:117] "RemoveContainer" containerID="acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"
Sep 17 09:59:46.234785 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234765    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd"} err="failed to get container status \"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd\": rpc error: code = NotFound desc = could not find container \"acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd\": container with ID starting with acaaa1915eb65264fcbc8924316a229af6d8cff8facd85a127d23db3d0279ccd not found: ID does not exist"
Sep 17 09:59:46.234785 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234784    2558 scope.go:117] "RemoveContainer" containerID="5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"
Sep 17 09:59:46.235016 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.234998    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0"} err="failed to get container status \"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0\": rpc error: code = NotFound desc = could not find container \"5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0\": container with ID starting with 5a5436f1c29a737daf24c5a2cb460dd4ae8005ef05bebf40375c1213053502c0 not found: ID does not exist"
Sep 17 09:59:46.235077 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.235016    2558 scope.go:117] "RemoveContainer" containerID="b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c"
Sep 17 09:59:46.237051 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.237029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-offline-tls\") pod \"9940ee5f-c763-46e7-a1b7-4867db1699ab\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") "
Sep 17 09:59:46.237146 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.237066    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9940ee5f-c763-46e7-a1b7-4867db1699ab-feast-data\") pod \"9940ee5f-c763-46e7-a1b7-4867db1699ab\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") "
Sep 17 09:59:46.237146 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.237092    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fxjs\" (UniqueName: \"kubernetes.io/projected/9940ee5f-c763-46e7-a1b7-4867db1699ab-kube-api-access-9fxjs\") pod \"9940ee5f-c763-46e7-a1b7-4867db1699ab\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") "
Sep 17 09:59:46.237317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.237150    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls\") pod \"9940ee5f-c763-46e7-a1b7-4867db1699ab\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") "
Sep 17 09:59:46.237317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.237214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-online-tls\") pod \"9940ee5f-c763-46e7-a1b7-4867db1699ab\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") "
Sep 17 09:59:46.237317 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.237245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-ui-tls\") pod \"9940ee5f-c763-46e7-a1b7-4867db1699ab\" (UID: \"9940ee5f-c763-46e7-a1b7-4867db1699ab\") "
Sep 17 09:59:46.238223 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.238184    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9940ee5f-c763-46e7-a1b7-4867db1699ab-feast-data" (OuterVolumeSpecName: "feast-data") pod "9940ee5f-c763-46e7-a1b7-4867db1699ab" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 09:59:46.239765 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.239739    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9940ee5f-c763-46e7-a1b7-4867db1699ab" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.239872 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.239789    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9940ee5f-c763-46e7-a1b7-4867db1699ab" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.239941 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.239920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9940ee5f-c763-46e7-a1b7-4867db1699ab-kube-api-access-9fxjs" (OuterVolumeSpecName: "kube-api-access-9fxjs") pod "9940ee5f-c763-46e7-a1b7-4867db1699ab" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab"). InnerVolumeSpecName "kube-api-access-9fxjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 09:59:46.240134 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.240109    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-online-tls" (OuterVolumeSpecName: "online-tls") pod "9940ee5f-c763-46e7-a1b7-4867db1699ab" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.240491 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.240455    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9940ee5f-c763-46e7-a1b7-4867db1699ab" (UID: "9940ee5f-c763-46e7-a1b7-4867db1699ab"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 09:59:46.249972 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.249952    2558 scope.go:117] "RemoveContainer" containerID="579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b"
Sep 17 09:59:46.256374 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.256356    2558 scope.go:117] "RemoveContainer" containerID="d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba"
Sep 17 09:59:46.262748 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.262726    2558 scope.go:117] "RemoveContainer" containerID="d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a"
Sep 17 09:59:46.268854 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.268834    2558 scope.go:117] "RemoveContainer" containerID="f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54"
Sep 17 09:59:46.275188 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275155    2558 scope.go:117] "RemoveContainer" containerID="b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c"
Sep 17 09:59:46.275446 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.275426    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c\": container with ID starting with b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c not found: ID does not exist" containerID="b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c"
Sep 17 09:59:46.275525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275455    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c"} err="failed to get container status \"b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c\": rpc error: code = NotFound desc = could not find container \"b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c\": container with ID starting with b0db8ed4a78c25432618c4f30f0a8d59e01350f401148d74477e0ceb8edced2c not found: ID does not exist"
Sep 17 09:59:46.275525 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275477    2558 scope.go:117] "RemoveContainer" containerID="579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b"
Sep 17 09:59:46.275719 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.275703    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b\": container with ID starting with 579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b not found: ID does not exist" containerID="579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b"
Sep 17 09:59:46.275758 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275724    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b"} err="failed to get container status \"579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b\": rpc error: code = NotFound desc = could not find container \"579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b\": container with ID starting with 579fc4ec7c23baff548b2bafe864d95f859707a35d3c6a04e9fc91c461c24a7b not found: ID does not exist"
Sep 17 09:59:46.275758 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275737    2558 scope.go:117] "RemoveContainer" containerID="d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba"
Sep 17 09:59:46.275950 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.275934    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba\": container with ID starting with d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba not found: ID does not exist" containerID="d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba"
Sep 17 09:59:46.275993 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275953    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba"} err="failed to get container status \"d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba\": rpc error: code = NotFound desc = could not find container \"d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba\": container with ID starting with d4a75cdfcded1ca9079cdec8cc2447b62133aeb3bb7e7f5bf5bc977cab0c5aba not found: ID does not exist"
Sep 17 09:59:46.275993 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.275966    2558 scope.go:117] "RemoveContainer" containerID="d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a"
Sep 17 09:59:46.276192 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.276176    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a\": container with ID starting with d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a not found: ID does not exist" containerID="d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a"
Sep 17 09:59:46.276261 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.276199    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a"} err="failed to get container status \"d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a\": rpc error: code = NotFound desc = could not find container \"d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a\": container with ID starting with d97faeb8535a60d7ffc4c36ba3a582c06b6952ede225944b809aa0143edd813a not found: ID does not exist"
Sep 17 09:59:46.276261 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.276218    2558 scope.go:117] "RemoveContainer" containerID="f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54"
Sep 17 09:59:46.276420 ip-10-0-135-161 kubenswrapper[2558]: E0917 09:59:46.276406    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54\": container with ID starting with f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54 not found: ID does not exist" containerID="f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54"
Sep 17 09:59:46.276455 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.276424    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54"} err="failed to get container status \"f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54\": rpc error: code = NotFound desc = could not find container \"f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54\": container with ID starting with f3cc66ca2e26101e1474daf03c00d8ececfc3fdd694e18c71fbf64b57eb64f54 not found: ID does not exist"
Sep 17 09:59:46.337796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.337728    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-offline-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.337796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.337752    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9940ee5f-c763-46e7-a1b7-4867db1699ab-feast-data\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.337796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.337761    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fxjs\" (UniqueName: \"kubernetes.io/projected/9940ee5f-c763-46e7-a1b7-4867db1699ab-kube-api-access-9fxjs\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.337796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.337771    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-registry-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.337796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.337779    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-online-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.337796 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.337786    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9940ee5f-c763-46e7-a1b7-4867db1699ab-ui-tls\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 09:59:46.514179 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.514140    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"]
Sep 17 09:59:46.524549 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:46.524519    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b22hg"]
Sep 17 09:59:47.459517 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:47.459488    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" path="/var/lib/kubelet/pods/84f58e93-4a77-4215-9c08-ea374f25c387/volumes"
Sep 17 09:59:47.460017 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:47.460003    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" path="/var/lib/kubelet/pods/9940ee5f-c763-46e7-a1b7-4867db1699ab/volumes"
Sep 17 09:59:55.422324 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:55.422296    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 09:59:55.423966 ip-10-0-135-161 kubenswrapper[2558]: I0917 09:59:55.423944    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 10:00:05.691063 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691022    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7t6xx/must-gather-5gj6c"]
Sep 17 10:00:05.691528 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691507    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="feast-apply"
Sep 17 10:00:05.691573 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691531    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="feast-apply"
Sep 17 10:00:05.691573 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691557    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="feast-init"
Sep 17 10:00:05.691573 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691565    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="feast-init"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691584    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691592    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691612    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="registry"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691620    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="registry"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691635    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="offline"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691644    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="offline"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691654    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="feast-apply"
Sep 17 10:00:05.691669 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691661    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="feast-apply"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691675    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691683    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691697    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691705    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691721    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="feast-init"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691729    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="feast-init"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691737    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691744    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691761    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691768    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691874    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="ui"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691890    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="registry"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691898    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="offline"
Sep 17 10:00:05.691910 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691906    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="ui"
Sep 17 10:00:05.692368 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691920    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84f58e93-4a77-4215-9c08-ea374f25c387" containerName="online"
Sep 17 10:00:05.692368 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691928    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="offline"
Sep 17 10:00:05.692368 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.691936    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9940ee5f-c763-46e7-a1b7-4867db1699ab" containerName="online"
Sep 17 10:00:05.695358 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.695337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:05.698809 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.698790    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7t6xx\"/\"default-dockercfg-s68l7\""
Sep 17 10:00:05.698917 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.698900    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7t6xx\"/\"openshift-service-ca.crt\""
Sep 17 10:00:05.700072 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.700056    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7t6xx\"/\"kube-root-ca.crt\""
Sep 17 10:00:05.708828 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.708799    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7t6xx/must-gather-5gj6c"]
Sep 17 10:00:05.769918 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.769887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58bsz\" (UniqueName: \"kubernetes.io/projected/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-kube-api-access-58bsz\") pod \"must-gather-5gj6c\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") " pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:05.770070 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.769926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-must-gather-output\") pod \"must-gather-5gj6c\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") " pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:05.870474 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.870426    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58bsz\" (UniqueName: \"kubernetes.io/projected/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-kube-api-access-58bsz\") pod \"must-gather-5gj6c\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") " pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:05.870474 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.870476    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-must-gather-output\") pod \"must-gather-5gj6c\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") " pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:05.870817 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.870786    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-must-gather-output\") pod \"must-gather-5gj6c\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") " pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:05.880499 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:05.880471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58bsz\" (UniqueName: \"kubernetes.io/projected/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-kube-api-access-58bsz\") pod \"must-gather-5gj6c\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") " pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:06.004138 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:06.004107    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:06.290510 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:06.290430    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7t6xx/must-gather-5gj6c"]
Sep 17 10:00:06.294096 ip-10-0-135-161 kubenswrapper[2558]: W0917 10:00:06.294071    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8f1a9c8_6be5_41fa_b49a_685d9b457b2b.slice/crio-32eaea9954a38380822169b16901226ab2f20f34eaa71ea6f5fa1c3db3effb34 WatchSource:0}: Error finding container 32eaea9954a38380822169b16901226ab2f20f34eaa71ea6f5fa1c3db3effb34: Status 404 returned error can't find the container with id 32eaea9954a38380822169b16901226ab2f20f34eaa71ea6f5fa1c3db3effb34
Sep 17 10:00:06.295735 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:06.295718    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 10:00:07.265911 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:07.265869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7t6xx/must-gather-5gj6c" event={"ID":"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b","Type":"ContainerStarted","Data":"32eaea9954a38380822169b16901226ab2f20f34eaa71ea6f5fa1c3db3effb34"}
Sep 17 10:00:13.292368 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:13.292333    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7t6xx/must-gather-5gj6c" event={"ID":"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b","Type":"ContainerStarted","Data":"89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667"}
Sep 17 10:00:13.292747 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:13.292382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7t6xx/must-gather-5gj6c" event={"ID":"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b","Type":"ContainerStarted","Data":"5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"}
Sep 17 10:00:13.314570 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:13.314512    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7t6xx/must-gather-5gj6c" podStartSLOduration=1.9519827250000001 podStartE2EDuration="8.314491123s" totalImagesPullingTime="6.362508398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:00:13.312671681 +0000 UTC m=+1818.378883446" watchObservedRunningTime="2026-09-17 10:00:13.314491123 +0000 UTC m=+1818.380702888"
Sep 17 10:00:22.323777 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:22.323682    2558 generic.go:356] "Generic (PLEG): container finished" podID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerID="5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff" exitCode=0
Sep 17 10:00:22.323777 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:22.323757    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7t6xx/must-gather-5gj6c" event={"ID":"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b","Type":"ContainerDied","Data":"5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"}
Sep 17 10:00:22.324393 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:22.324155    2558 scope.go:117] "RemoveContainer" containerID="5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"
Sep 17 10:00:23.034880 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:23.034836    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7t6xx_must-gather-5gj6c_a8f1a9c8-6be5-41fa-b49a-685d9b457b2b/gather/0.log"
Sep 17 10:00:26.733603 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:26.733561    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q2c7j_6064f505-1120-4de6-b9c5-8f42dde52edc/global-pull-secret-syncer/0.log"
Sep 17 10:00:26.842948 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:26.842913    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pskj4_a79e6e8e-f387-41df-896b-d6e6f3e975f4/konnectivity-agent/0.log"
Sep 17 10:00:26.862154 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:26.862127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-161.ec2.internal_cd26d2a477286a933410d5e0d7e26830/haproxy/0.log"
Sep 17 10:00:28.366221 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.366190    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-7t6xx/must-gather-5gj6c"]
Sep 17 10:00:28.366705 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.366361    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-7t6xx/must-gather-5gj6c" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="copy" containerID="cri-o://89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667" gracePeriod=2
Sep 17 10:00:28.372796 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.372769    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-7t6xx/must-gather-5gj6c"]
Sep 17 10:00:28.373232 ip-10-0-135-161 kubenswrapper[2558]: E0917 10:00:28.373206    2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-7t6xx\"/\"must-gather-5gj6c\": pods \"must-gather-5gj6c\" not found" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:28.586183 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.586148    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7t6xx_must-gather-5gj6c_a8f1a9c8-6be5-41fa-b49a-685d9b457b2b/copy/0.log"
Sep 17 10:00:28.587605 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.587588    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:28.589996 ip-10-0-135-161 kubenswrapper[2558]: E0917 10:00:28.589975    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5gj6c\" is forbidden: User \"system:node:ip-10-0-135-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7t6xx\": no relationship found between node 'ip-10-0-135-161.ec2.internal' and this object" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:28.623055 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.622989    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58bsz\" (UniqueName: \"kubernetes.io/projected/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-kube-api-access-58bsz\") pod \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") "
Sep 17 10:00:28.623055 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.623052    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-must-gather-output\") pod \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\" (UID: \"a8f1a9c8-6be5-41fa-b49a-685d9b457b2b\") "
Sep 17 10:00:28.623443 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.623422    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" (UID: "a8f1a9c8-6be5-41fa-b49a-685d9b457b2b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 10:00:28.625141 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.625120    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-kube-api-access-58bsz" (OuterVolumeSpecName: "kube-api-access-58bsz") pod "a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" (UID: "a8f1a9c8-6be5-41fa-b49a-685d9b457b2b"). InnerVolumeSpecName "kube-api-access-58bsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 10:00:28.723516 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.723490    2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-must-gather-output\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 10:00:28.723516 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:28.723510    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58bsz\" (UniqueName: \"kubernetes.io/projected/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b-kube-api-access-58bsz\") on node \"ip-10-0-135-161.ec2.internal\" DevicePath \"\""
Sep 17 10:00:29.348264 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.348236    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-7t6xx_must-gather-5gj6c_a8f1a9c8-6be5-41fa-b49a-685d9b457b2b/copy/0.log"
Sep 17 10:00:29.348611 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.348584    2558 generic.go:356] "Generic (PLEG): container finished" podID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerID="89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667" exitCode=143
Sep 17 10:00:29.348736 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.348632    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:29.348736 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.348670    2558 scope.go:117] "RemoveContainer" containerID="89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667"
Sep 17 10:00:29.353009 ip-10-0-135-161 kubenswrapper[2558]: E0917 10:00:29.352979    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5gj6c\" is forbidden: User \"system:node:ip-10-0-135-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7t6xx\": no relationship found between node 'ip-10-0-135-161.ec2.internal' and this object" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:29.356778 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.356761    2558 scope.go:117] "RemoveContainer" containerID="5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"
Sep 17 10:00:29.360116 ip-10-0-135-161 kubenswrapper[2558]: E0917 10:00:29.360090    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5gj6c\" is forbidden: User \"system:node:ip-10-0-135-161.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-7t6xx\": no relationship found between node 'ip-10-0-135-161.ec2.internal' and this object" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" pod="openshift-must-gather-7t6xx/must-gather-5gj6c"
Sep 17 10:00:29.368247 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.368062    2558 scope.go:117] "RemoveContainer" containerID="89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667"
Sep 17 10:00:29.368487 ip-10-0-135-161 kubenswrapper[2558]: E0917 10:00:29.368352    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667\": container with ID starting with 89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667 not found: ID does not exist" containerID="89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667"
Sep 17 10:00:29.368487 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.368379    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667"} err="failed to get container status \"89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667\": rpc error: code = NotFound desc = could not find container \"89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667\": container with ID starting with 89e44c449946ad6e6da7b9ff00b50a8a43ce99ec2eac31eaf2c266901d16f667 not found: ID does not exist"
Sep 17 10:00:29.368487 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.368397    2558 scope.go:117] "RemoveContainer" containerID="5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"
Sep 17 10:00:29.368698 ip-10-0-135-161 kubenswrapper[2558]: E0917 10:00:29.368679    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff\": container with ID starting with 5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff not found: ID does not exist" containerID="5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"
Sep 17 10:00:29.368738 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.368703    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff"} err="failed to get container status \"5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff\": rpc error: code = NotFound desc = could not find container \"5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff\": container with ID starting with 5b64b970a54dd13e8f191c96e9f7ad598d4a5db5481579c1b7ededc6c01123ff not found: ID does not exist"
Sep 17 10:00:29.460315 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:29.460283    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" path="/var/lib/kubelet/pods/a8f1a9c8-6be5-41fa-b49a-685d9b457b2b/volumes"
Sep 17 10:00:30.998666 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:30.998637    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxfxk_7228663a-7f02-4afb-9ff0-236b802153ba/node-exporter/0.log"
Sep 17 10:00:31.021560 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:31.021535    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxfxk_7228663a-7f02-4afb-9ff0-236b802153ba/kube-rbac-proxy/0.log"
Sep 17 10:00:31.042746 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:31.042723    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxfxk_7228663a-7f02-4afb-9ff0-236b802153ba/init-textfile/0.log"
Sep 17 10:00:33.363042 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:33.363015    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-ps8xp_2616cf3e-1a5f-4e12-afea-19b95b7f41b9/networking-console-plugin/0.log"
Sep 17 10:00:33.853450 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:33.853413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/1.log"
Sep 17 10:00:33.858001 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:33.857980    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ch5ql_df5605f0-007b-44a6-bca6-8136488169c8/console-operator/2.log"
Sep 17 10:00:35.062121 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062087    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"]
Sep 17 10:00:35.062504 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062325    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="gather"
Sep 17 10:00:35.062504 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062337    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="gather"
Sep 17 10:00:35.062504 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062358    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="copy"
Sep 17 10:00:35.062504 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062363    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="copy"
Sep 17 10:00:35.062504 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062401    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="gather"
Sep 17 10:00:35.062504 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.062410    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f1a9c8-6be5-41fa-b49a-685d9b457b2b" containerName="copy"
Sep 17 10:00:35.065870 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.065849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.068455 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.068437    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5v8j2\"/\"kube-root-ca.crt\""
Sep 17 10:00:35.069785 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.069684    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5v8j2\"/\"default-dockercfg-24fvl\""
Sep 17 10:00:35.069785 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.069713    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5v8j2\"/\"openshift-service-ca.crt\""
Sep 17 10:00:35.075952 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.075931    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"]
Sep 17 10:00:35.166749 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.166709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rvkm\" (UniqueName: \"kubernetes.io/projected/d1d63f66-07ee-4723-bd71-51a00038e5c7-kube-api-access-9rvkm\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.166749 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.166748    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-podres\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.166988 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.166776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-proc\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.166988 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.166816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-lib-modules\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.166988 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.166842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-sys\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267647 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267615    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rvkm\" (UniqueName: \"kubernetes.io/projected/d1d63f66-07ee-4723-bd71-51a00038e5c7-kube-api-access-9rvkm\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267771 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267652    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-podres\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267771 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-proc\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267771 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267697    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-lib-modules\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267942 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-proc\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267942 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-lib-modules\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267942 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267807    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-podres\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267942 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-sys\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.267942 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.267850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1d63f66-07ee-4723-bd71-51a00038e5c7-sys\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.276493 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.276471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rvkm\" (UniqueName: \"kubernetes.io/projected/d1d63f66-07ee-4723-bd71-51a00038e5c7-kube-api-access-9rvkm\") pod \"perf-node-gather-daemonset-cblqm\" (UID: \"d1d63f66-07ee-4723-bd71-51a00038e5c7\") " pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.375406 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.375327    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:35.646346 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.646316    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"]
Sep 17 10:00:35.648628 ip-10-0-135-161 kubenswrapper[2558]: W0917 10:00:35.648602    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1d63f66_07ee_4723_bd71_51a00038e5c7.slice/crio-409af94025e0a8fd7c4bd05925a6044baa1135650f04ecea77258b38f168022d WatchSource:0}: Error finding container 409af94025e0a8fd7c4bd05925a6044baa1135650f04ecea77258b38f168022d: Status 404 returned error can't find the container with id 409af94025e0a8fd7c4bd05925a6044baa1135650f04ecea77258b38f168022d
Sep 17 10:00:35.769565 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.769540    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zjm4h_79985231-f3e8-452d-ba6f-b9e91e723e20/dns/0.log"
Sep 17 10:00:35.829212 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.829187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zjm4h_79985231-f3e8-452d-ba6f-b9e91e723e20/kube-rbac-proxy/0.log"
Sep 17 10:00:35.908302 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:35.908238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c5jjl_447b39be-328f-4aa0-beac-192550796811/dns-node-resolver/0.log"
Sep 17 10:00:36.372396 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:36.372361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm" event={"ID":"d1d63f66-07ee-4723-bd71-51a00038e5c7","Type":"ContainerStarted","Data":"8b0a298b85b6094f1f4af2f3b364a9315d5f49da6d68f9e44f6f3f0c559a9604"}
Sep 17 10:00:36.372806 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:36.372439    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm" event={"ID":"d1d63f66-07ee-4723-bd71-51a00038e5c7","Type":"ContainerStarted","Data":"409af94025e0a8fd7c4bd05925a6044baa1135650f04ecea77258b38f168022d"}
Sep 17 10:00:36.372806 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:36.372530    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:36.394354 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:36.394309    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm" podStartSLOduration=1.394295932 podStartE2EDuration="1.394295932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:00:36.393443604 +0000 UTC m=+1841.459655371" watchObservedRunningTime="2026-09-17 10:00:36.394295932 +0000 UTC m=+1841.460507696"
Sep 17 10:00:36.403852 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:36.403834    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b977w_9d211350-a515-4b38-a4a3-f82de45b1476/node-ca/0.log"
Sep 17 10:00:37.752996 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:37.752963    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p2qq6_8acd66fa-2c9b-4f60-a733-886354a893cd/serve-healthcheck-canary/0.log"
Sep 17 10:00:38.322273 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:38.322242    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8fs2_5f1e4cba-5232-486f-883c-0290155b0b63/kube-rbac-proxy/0.log"
Sep 17 10:00:38.359074 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:38.359050    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8fs2_5f1e4cba-5232-486f-883c-0290155b0b63/exporter/0.log"
Sep 17 10:00:38.390978 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:38.390952    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h8fs2_5f1e4cba-5232-486f-883c-0290155b0b63/extractor/0.log"
Sep 17 10:00:42.385039 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:42.385006    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5v8j2/perf-node-gather-daemonset-cblqm"
Sep 17 10:00:44.191969 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.191921    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/kube-multus-additional-cni-plugins/0.log"
Sep 17 10:00:44.217746 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.217720    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/egress-router-binary-copy/0.log"
Sep 17 10:00:44.242536 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.242512    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/cni-plugins/0.log"
Sep 17 10:00:44.266435 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.266407    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/bond-cni-plugin/0.log"
Sep 17 10:00:44.287633 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.287609    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/routeoverride-cni/0.log"
Sep 17 10:00:44.315224 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.315198    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/whereabouts-cni-bincopy/0.log"
Sep 17 10:00:44.342229 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.342201    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wh6wb_6d4ec09b-e1ce-4461-bdfd-39f55cff06f4/whereabouts-cni/0.log"
Sep 17 10:00:44.379517 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.379445    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b28mk_81cb6af9-acaa-4f87-b164-699cadd29584/kube-multus/0.log"
Sep 17 10:00:44.518948 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.518923    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-smn2j_87d3569c-fa7b-4bad-bc42-d7b1869b4c39/network-metrics-daemon/0.log"
Sep 17 10:00:44.541656 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:44.541635    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-smn2j_87d3569c-fa7b-4bad-bc42-d7b1869b4c39/kube-rbac-proxy/0.log"
Sep 17 10:00:45.776851 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.776825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/ovn-controller/0.log"
Sep 17 10:00:45.794039 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.794017    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/ovn-acl-logging/0.log"
Sep 17 10:00:45.817811 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.817790    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/kube-rbac-proxy-node/0.log"
Sep 17 10:00:45.840609 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.840580    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 10:00:45.862493 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.862472    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/northd/0.log"
Sep 17 10:00:45.894116 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.894094    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/nbdb/0.log"
Sep 17 10:00:45.918291 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.918272    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/sbdb/0.log"
Sep 17 10:00:45.961666 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:45.961643    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xfx6s_ef44d4bb-87b8-4dc8-b89b-33243fdc9c08/ovnkube-controller/0.log"
Sep 17 10:00:46.909616 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:46.909567    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-cgr5c_389cac15-7d06-4893-a6c7-9728665f9eb3/check-endpoints/0.log"
Sep 17 10:00:46.930967 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:46.930945    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cksrw_ee7916f6-be31-4a69-a45d-9782fd83af26/network-check-target-container/0.log"
Sep 17 10:00:47.889004 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:47.888976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6f5d7_c18a7c6c-b3d6-4b61-ac1e-b9e1d55ec63d/iptables-alerter/0.log"
Sep 17 10:00:48.544986 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:48.544955    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-frvkt_f980a297-45dd-4937-a2d0-5ffcfbe905c9/tuned/0.log"
Sep 17 10:00:51.520197 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:51.520146    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-568869fdc5-6k554_7e854ff7-6399-4c81-9c26-1cf4f9d158ba/service-ca-controller/0.log"
Sep 17 10:00:51.942117 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:51.942036    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-4sf4j_33a37648-5f12-46fa-8162-136a1b6322b9/csi-driver/0.log"
Sep 17 10:00:51.964223 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:51.964201    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-4sf4j_33a37648-5f12-46fa-8162-136a1b6322b9/csi-node-driver-registrar/0.log"
Sep 17 10:00:51.988682 ip-10-0-135-161 kubenswrapper[2558]: I0917 10:00:51.988656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-4sf4j_33a37648-5f12-46fa-8162-136a1b6322b9/csi-liveness-probe/0.log"