Sep 17 16:19:01.277653 ip-10-0-128-87 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 16:19:01.638521 ip-10-0-128-87 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 16:19:01.638521 ip-10-0-128-87 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 16:19:01.638521 ip-10-0-128-87 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 16:19:01.638521 ip-10-0-128-87 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 16:19:01.638521 ip-10-0-128-87 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 16:19:01.640286 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.640200    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 16:19:01.644197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644181    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:19:01.644197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644197    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644202    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644206    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644209    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644212    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644215    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644217    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644220    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644222    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644225    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644233    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644236    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644238    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644241    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644243    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644246    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644249    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644253    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644257    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644260    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:19:01.644263 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644262    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644265    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644268    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644271    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644274    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644277    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644280    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644282    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644285    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644287    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644290    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644292    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644295    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644297    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644300    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644302    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644305    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644308    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644310    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644313    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:19:01.644801 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644315    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644320    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644323    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644325    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644327    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644330    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644332    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644334    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644337    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644340    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644342    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644345    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644348    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644352    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644356    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644359    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644362    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644365    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644367    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:19:01.645377 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644370    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644373    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644375    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644378    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644380    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644383    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644397    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644400    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644403    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644406    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644408    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644411    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644413    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644416    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644419    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644423    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644426    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644429    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644431    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644434    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:19:01.645874 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644437    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644441    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644443    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644446    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644448    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644451    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644453    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644456    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644459    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644461    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644464    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644468    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644472    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644476    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644478    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644481    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644484    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644487    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.644490    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645174    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:19:01.646361 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645180    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645183    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645186    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645189    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645191    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645194    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645197    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645200    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645203    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645208    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645212    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645214    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645217    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645220    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645223    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645226    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645228    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645231    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645234    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645236    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:19:01.646847 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645239    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645242    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645245    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645247    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645250    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645254    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645258    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645260    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645263    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645265    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645268    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645270    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645273    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645275    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645278    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645281    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645284    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645286    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645289    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:19:01.647337 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645291    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645295    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645298    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645300    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645303    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645305    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645308    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645311    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645313    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645315    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645318    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645320    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645323    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645325    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645328    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645331    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645334    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645336    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645338    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645341    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:19:01.647833 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645344    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645346    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645348    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645351    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645353    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645356    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645359    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645361    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645364    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645366    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645369    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645372    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645374    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645377    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645379    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645382    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645402    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645406    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645410    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645413    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:19:01.648320 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645415    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645418    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645420    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645423    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645425    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645428    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645430    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645433    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645435    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645438    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645440    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645443    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645446    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645449    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645451    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645453    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645456    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645460    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645463    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:19:01.648836 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645824    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645829    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645832    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645837    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645841    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645844    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645846    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645849    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645852    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645855    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645857    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645860    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645862    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645865    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645868    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645870    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645873    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645875    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645878    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645881    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:19:01.649300 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645883    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645886    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645889    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645891    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645895    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645899    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645901    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645904    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645907    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645911    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645914    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645917    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645920    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645923    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645925    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645930    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645932    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645935    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645937    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:19:01.649790 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645940    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645942    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645945    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645948    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645950    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645952    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645955    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645957    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645960    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645962    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645965    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645967    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645970    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645972    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645974    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645977    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645979    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645983    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645985    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:19:01.650281 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645988    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645990    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645992    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645995    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.645998    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646000    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646003    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646005    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646008    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646012    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646014    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646016    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646020    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646022    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646025    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646027    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646030    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646033    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646035    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646038    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:19:01.650752 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646040    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646043    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646045    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646048    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646050    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646053    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646055    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646057    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646060    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646063    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646065    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646067    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646070    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646072    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646075    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646077    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646080    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646083    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646086    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:19:01.651225 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646089    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646092    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646167    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646198    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646205    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646209    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646216    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646221    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646227    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646251    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646271    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646276    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646281    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646285    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646288    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646291    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646294    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646298    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646301    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646304    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646310    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646313    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646316    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646319    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 16:19:01.651741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646323    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646327    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646330    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646334    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646337    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646340    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646343    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646346    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646349    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646352    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646357    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646360    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646363    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646366    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646369    2582 flags.go:64] FLAG: --enable-server="true"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646372    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646377    2582 flags.go:64] FLAG: --event-burst="100"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646380    2582 flags.go:64] FLAG: --event-qps="50"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646384    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646400    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646404    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646408    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646411    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646414    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646417    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 17 16:19:01.652322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646419    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646422    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646425    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646428    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646431    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646434    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646437    2582 flags.go:64] FLAG: --feature-gates=""
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646440    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646443    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646446    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646449    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646453    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646456    2582 flags.go:64] FLAG: --help="false"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646459    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-128-87.ec2.internal"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646462    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646464    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646467    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646471    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646475    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646478    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646481    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646484    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646486    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 16:19:01.652924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646489    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646493    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646496    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646501    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646504    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646507    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646510    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646513    2582 flags.go:64] FLAG: --lock-file=""
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646515    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646518    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646521    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646527    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646529    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646532    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646535    2582 flags.go:64] FLAG: --logging-format="text"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646538    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646541    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646544    2582 flags.go:64] FLAG: --manifest-url=""
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646547    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646552    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646555    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646559    2582 flags.go:64] FLAG: --max-pods="110"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646562    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646565    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646568    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 16:19:01.653526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646570    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646573    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646576    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646579    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646587    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646590    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646593    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646596    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646599    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646607    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646611    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646614    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646617    2582 flags.go:64] FLAG: --port="10250"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646621    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646623    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-014b4920619e819fe"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646626    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646629    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646632    2582 flags.go:64] FLAG: --register-node="true"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646635    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646639    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646642    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646645    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646648    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646652    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646655    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 16:19:01.654379 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646658    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646662    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646664    2582 flags.go:64] FLAG: --runonce="false"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646668    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646671    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646674    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646677    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646679    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646682    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646685    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646688    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646691    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646693    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646696    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646699    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646702    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646707    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646711    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646716    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646719    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646722    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646727    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646730    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646733    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646735    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 16:19:01.655179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646738    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646741    2582 flags.go:64] FLAG: --v="2"
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646745    2582 flags.go:64] FLAG: --version="false"
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646749    2582 flags.go:64] FLAG: --vmodule=""
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646752    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.646756    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646904    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646909    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646912    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646915    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646917    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646921    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646923    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646927    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646929    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646932    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646935    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646937    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646940    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646943    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646945    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:19:01.655839 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646949    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646952    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646958    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646963    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646966    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646969    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646972    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646975    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646977    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646980    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646982    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646985    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646988    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646990    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646993    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646995    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.646998    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647000    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647003    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647005    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:19:01.656354 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647008    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647011    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647013    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647016    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647019    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647021    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647024    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647026    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647028    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647031    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647033    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647036    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647038    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647041    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647056    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647062    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647065    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647068    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647070    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647074    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:19:01.656868 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647076    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647079    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647081    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647084    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647086    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647089    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647091    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647094    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647096    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647099    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647101    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647104    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647107    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647109    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647112    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647114    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647116    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647119    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647122    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647124    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:19:01.657368 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647127    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647129    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647131    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647134    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647137    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647139    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647143    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647147    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647149    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647154    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647157    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647160    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647163    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647166    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647169    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647172    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647175    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647177    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647180    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:19:01.657867 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647182    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647185    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647187    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647190    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.647192    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.647768    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.656107    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.656242    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.657007    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.657016    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657077    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657083    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657087    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657092    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:19:01.658327 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657095    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657098    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657101    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657104    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657107    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657110    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657112    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657115    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657117    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657120    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657122    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657125    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657132    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657135    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657138    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657140    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657143    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657145    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657148    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657151    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:19:01.658738 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657153    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657156    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657158    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657161    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657163    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657167    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657171    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657175    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657178    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657180    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657183    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657186    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657188    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657192    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657195    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657199    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657201    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657204    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657207    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657210    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:19:01.659231 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657212    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657215    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657218    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657220    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657223    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657226    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657228    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657231    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657233    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657235    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657238    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657241    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657244    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657246    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657249    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657251    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657254    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657257    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657259    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657262    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:19:01.659735 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657265    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657267    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657270    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657272    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657275    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657278    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657280    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657283    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657285    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657288    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657290    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657293    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657295    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657298    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657300    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657303    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657306    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657308    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657311    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657313    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:19:01.660213 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657315    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657318    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657320    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657324    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657326    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657329    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657331    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657334    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657336    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657339    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657341    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657344    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657346    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657349    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657351    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:19:01.660737 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.657356    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657499    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657504    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657507    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657511    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657515    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657519    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657522    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657525    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657528    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657530    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657533    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657536    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657539    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657542    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657544    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657547    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657550    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657552    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657555    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 16:19:01.661197 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657557    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657559    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657562    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657564    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657567    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657570    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657572    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657574    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657577    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657580    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657583    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657585    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657587    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657590    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657593    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657595    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657597    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657600    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657603    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657605    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 16:19:01.661719 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657608    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657610    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657613    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657615    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657618    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657621    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657624    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657626    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657629    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657631    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657634    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657636    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657639    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657641    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657643    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657646    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657648    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657651    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657653    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657656    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 16:19:01.662271 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657658    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657660    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657664    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657667    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657670    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657673    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657676    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657679    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657681    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657683    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657686    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657688    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657691    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657693    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657696    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657698    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657701    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657703    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657706    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 16:19:01.662913 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657709    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657712    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657714    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657716    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657719    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657721    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657725    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657728    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657731    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657734    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657737    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657740    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657742    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657745    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657748    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657751    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657754    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657757    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657759    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 16:19:01.663680 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657762    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:01.657764    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.657769    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.657878    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.660065    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.660900    2582 server.go:1019] "Starting client certificate rotation"
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.661002    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.661749    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 16:19:01.664134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.663237    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 16:19:01.666032 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.666015    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 16:19:01.675111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.675095    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 17 16:19:01.676871 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.676856    2582 log.go:25] "Validated CRI v1 image API"
Sep 17 16:19:01.677755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.677737    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 16:19:01.680412 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.680371    2582 fs.go:135] Filesystem UUIDs: map[494c8fd8-0177-43e2-8443-1ad074e08fb5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9609dc9c-222d-45f4-a3e2-4eb53c7e3e2c:/dev/nvme0n1p3]
Sep 17 16:19:01.680473 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.680411    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 16:19:01.687185 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.687074    2582 manager.go:216] Machine: {Timestamp:2026-09-17 16:19:01.686608683 +0000 UTC m=+0.303504497 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080715 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2084606b190ca75f83b4f05bb03e60 SystemUUID:ec208460-6b19-0ca7-5f83-b4f05bb03e60 BootID:ee1d8801-5ab0-4dff-ad9d-d83fbe60bc02 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fe:47:ab:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fe:47:ab:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:12:86:aa:1e:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 16:19:01.687185 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.687176    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 16:19:01.687317 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.687286    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 16:19:01.690365 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.690332    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 16:19:01.690547 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.690368    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 16:19:01.691557 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.691541    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 16:19:01.691557 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.691560    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 16:19:01.691654 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.691571    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 16:19:01.692214 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.692203    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 16:19:01.693593 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.693581    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 16:19:01.696464 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.696445    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 16:19:01.697993 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.697980    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 16:19:01.698131 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698119    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 16:19:01.698193 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698158    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 16:19:01.698193 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698173    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 16:19:01.698193 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698187    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 16:19:01.698312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698200    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 17 16:19:01.698312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698214    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 16:19:01.698638 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698624    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 16:19:01.698713 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.698648    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 16:19:01.701185 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.701169    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 16:19:01.703736 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.703718    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 16:19:01.703787 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.703754    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 16:19:01.705057 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705043    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 16:19:01.705110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705064    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 16:19:01.705110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705074    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 16:19:01.705110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705083    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 16:19:01.705110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705095    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 16:19:01.705110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705103    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705120    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705128    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705137    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705145    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705170    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705179    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705210    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 16:19:01.705242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.705217    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 16:19:01.708950 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.708937    2582 server.go:1268] "Started kubelet"
Sep 17 16:19:01.709060 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.709027    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 16:19:01.709191 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.709095    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 16:19:01.709260 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.709241    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 16:19:01.710094 ip-10-0-128-87 systemd[1]: Started Kubernetes Kubelet.
Sep 17 16:19:01.710255 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.710132    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 16:19:01.710255 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.710169    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 16:19:01.710750 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.710723    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 16:19:01.710750 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.710723    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 16:19:01.710891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.710779    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 16:19:01.713311 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.713284    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 16:19:01.716810 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.715931    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-87.ec2.internal.18d6280dcf987302  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-87.ec2.internal,UID:ip-10-0-128-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-87.ec2.internal,},FirstTimestamp:2026-09-17 16:19:01.708911362 +0000 UTC m=+0.325807219,LastTimestamp:2026-09-17 16:19:01.708911362 +0000 UTC m=+0.325807219,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-87.ec2.internal,}"
Sep 17 16:19:01.719594 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.719577    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 16:19:01.719932 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.719916    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 16:19:01.720151 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.720129    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:01.721095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.720887    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 16:19:01.721187 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721098    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 16:19:01.721377 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.720892    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 16:19:01.721619 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721597    2582 factory.go:55] Registering systemd factory
Sep 17 16:19:01.721693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721622    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 17 16:19:01.721860 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721845    2582 factory.go:153] Registering CRI-O factory
Sep 17 16:19:01.721910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721864    2582 factory.go:223] Registration of the crio container factory successfully
Sep 17 16:19:01.721962 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721916    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 16:19:01.721962 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721932    2582 factory.go:103] Registering Raw factory
Sep 17 16:19:01.721962 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.721945    2582 manager.go:1196] Started watching for new ooms in manager
Sep 17 16:19:01.722226 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.722212    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 16:19:01.722226 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.722224    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 16:19:01.726446 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.723318    2582 manager.go:349] Starting recovery of all containers
Sep 17 16:19:01.726446 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.724812    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 16:19:01.726446 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.724921    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 16:19:01.730713 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.730689    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7t9h2"
Sep 17 16:19:01.735976 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.735955    2582 manager.go:354] Recovery completed
Sep 17 16:19:01.737507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.737487    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7t9h2"
Sep 17 16:19:01.740228 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.740214    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.742217 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742199    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.742278 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742238    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.742278 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742253    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.742798 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742784    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 16:19:01.742798 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742798    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 16:19:01.742890 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742811    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.742890 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.742815    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 16:19:01.743668 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.743654    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.743731 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.743679    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.743731 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.743687    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.744489 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.744370    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-87.ec2.internal.18d6280dd1949ece  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-87.ec2.internal,UID:ip-10-0-128-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-87.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-87.ec2.internal,},FirstTimestamp:2026-09-17 16:19:01.742214862 +0000 UTC m=+0.359110674,LastTimestamp:2026-09-17 16:19:01.742214862 +0000 UTC m=+0.359110674,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-87.ec2.internal,}"
Sep 17 16:19:01.744859 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.744847    2582 policy_none.go:49] "None policy: Start"
Sep 17 16:19:01.744910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.744863    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 16:19:01.744910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.744872    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 16:19:01.746862 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.746852    2582 policy_none.go:47] "Start"
Sep 17 16:19:01.782013 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.781993    2582 manager.go:337] "Starting Device Plugin manager"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.782038    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.782047    2582 server.go:87] "Starting device plugin registration server"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.782309    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.782320    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.782427    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.782502    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.782510    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.783120    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 16:19:01.801792 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.783175    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:01.849659 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.849627    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 16:19:01.850906 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.850889    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 16:19:01.851022 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.850938    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 16:19:01.851022 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.850961    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 16:19:01.851022 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.850997    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 16:19:01.854198 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.854182    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:01.882681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.882657    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.883662 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.883647    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.883726 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.883684    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.883726 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.883699    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.883726 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.883721    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-87.ec2.internal"
Sep 17 16:19:01.890689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.890618    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-87.ec2.internal"
Sep 17 16:19:01.890689 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.890640    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-87.ec2.internal\": node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:01.911288 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.911263    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:01.951402 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.951341    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"]
Sep 17 16:19:01.951634 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.951486    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.955553 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.955535    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.955657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.955571    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.955657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.955592    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.957945 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.957929    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.958060 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.958043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:01.958117 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.958076    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.972542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.971529    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.972542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.971562    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.972542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.971585    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.972542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.971642    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.972542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.971674    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.972542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.971688    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.974071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.974054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:01.974160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.974089    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 16:19:01.974874 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.974858    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 16:19:01.974970 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.974886    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 16:19:01.974970 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:01.974896    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeHasSufficientPID"
Sep 17 16:19:01.998073 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:01.998046    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-87.ec2.internal\" not found" node="ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.002516 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.002503    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-87.ec2.internal\" not found" node="ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.011580 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.011565    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.023856 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.023833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2d3e7ffff061ae8160402b23c744e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"f2d3e7ffff061ae8160402b23c744e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.023916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.023861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2d3e7ffff061ae8160402b23c744e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"f2d3e7ffff061ae8160402b23c744e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.023916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.023883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0b7dfb22338a242f82fb89abf533158-config\") pod \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" (UID: \"b0b7dfb22338a242f82fb89abf533158\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.112314 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.112262    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.124717 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.124692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2d3e7ffff061ae8160402b23c744e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"f2d3e7ffff061ae8160402b23c744e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.124786 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.124720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2d3e7ffff061ae8160402b23c744e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"f2d3e7ffff061ae8160402b23c744e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.124786 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.124737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0b7dfb22338a242f82fb89abf533158-config\") pod \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" (UID: \"b0b7dfb22338a242f82fb89abf533158\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.124848 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.124791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b0b7dfb22338a242f82fb89abf533158-config\") pod \"kube-apiserver-proxy-ip-10-0-128-87.ec2.internal\" (UID: \"b0b7dfb22338a242f82fb89abf533158\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.124848 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.124791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f2d3e7ffff061ae8160402b23c744e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"f2d3e7ffff061ae8160402b23c744e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.124848 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.124825    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2d3e7ffff061ae8160402b23c744e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal\" (UID: \"f2d3e7ffff061ae8160402b23c744e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.213173 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.213100    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.302716 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.302677    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.306861 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.306843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:02.313620 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.313604    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.414193 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.414156    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.514833 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.514758    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.532375 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.532352    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:02.614902 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.614878    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.620818 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.620802    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:02.661020 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.660988    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 16:19:02.661424 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.661141    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 16:19:02.661424 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.661173    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 16:19:02.661424 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.661176    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 16:19:02.715319 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.715300    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.744399 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.744355    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 16:14:02 +0000 UTC" deadline="2028-05-19 21:34:47.818321686 +0000 UTC"
Sep 17 16:19:02.744466 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:02.744384    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14645h15m45.073941427s"
Sep 17 16:19:02.815777 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.815699    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:02.916167 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:02.916137    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:03.016710 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.016680    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-87.ec2.internal\" not found"
Sep 17 16:19:03.105305 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.105279    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:03.120786 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.120761    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:03.136607 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.136462    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 16:19:03.137491 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.137477    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal"
Sep 17 16:19:03.146860 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.146845    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 16:19:03.213637 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:03.213595    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b7dfb22338a242f82fb89abf533158.slice/crio-d2c6bf1bf9f291653aa52a04501210d64bd5cc3a30f1dc13573cb195cdaf4a9a WatchSource:0}: Error finding container d2c6bf1bf9f291653aa52a04501210d64bd5cc3a30f1dc13573cb195cdaf4a9a: Status 404 returned error can't find the container with id d2c6bf1bf9f291653aa52a04501210d64bd5cc3a30f1dc13573cb195cdaf4a9a
Sep 17 16:19:03.213946 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:03.213924    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d3e7ffff061ae8160402b23c744e28.slice/crio-f73a55bc7710358f3bd58515dbe63c2d4b4a3a2d2bc81cea7e3f73586e89c9f0 WatchSource:0}: Error finding container f73a55bc7710358f3bd58515dbe63c2d4b4a3a2d2bc81cea7e3f73586e89c9f0: Status 404 returned error can't find the container with id f73a55bc7710358f3bd58515dbe63c2d4b4a3a2d2bc81cea7e3f73586e89c9f0
Sep 17 16:19:03.218687 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.218671    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:19:03.530775 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.530693    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:03.701719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.701690    2582 apiserver.go:52] "Watching apiserver"
Sep 17 16:19:03.709976 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.709950    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 16:19:03.710409 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.710385    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-c7bhg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-wxgq2","kube-system/konnectivity-agent-zvmpq","kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7bzn5","openshift-multus/multus-additional-cni-plugins-p4bdq","openshift-multus/multus-bqtzg","openshift-multus/network-metrics-daemon-kn6qg","openshift-network-diagnostics/network-check-target-nxrgg","openshift-network-operator/iptables-alerter-4skrg","kube-system/global-pull-secret-syncer-k6kvk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w","openshift-dns/node-resolver-ftr9x"]
Sep 17 16:19:03.714691 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.714674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.716927 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.716907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.718658 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.718634    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 16:19:03.718779 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.718649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.718779 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.718725    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 16:19:03.718779 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.718654    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 16:19:03.718779 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.718641    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.718779 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.718667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5rc5w\""
Sep 17 16:19:03.720501 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.719885    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.720501 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.720266    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 16:19:03.721403 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.721375    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 16:19:03.721934 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.721914    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.722028 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.721992    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.722381 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.722198    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h4dxf\""
Sep 17 16:19:03.722724 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.722707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.724111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.724082    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c99pw\""
Sep 17 16:19:03.724624 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.724604    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 16:19:03.724754 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.724729    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 16:19:03.724873 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.724756    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 16:19:03.725578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.725558    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 16:19:03.726324 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.726308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.726935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.726913    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dvfwl\""
Sep 17 16:19:03.726935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.726929    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.727094 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.726969    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 16:19:03.727149 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.727093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.727322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.727301    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 16:19:03.729559 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.729542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.731135 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.731114    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.731229 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.731134    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tw6d5\""
Sep 17 16:19:03.731229 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.731150    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.731867 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.731848    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:03.732011 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.731953    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:03.732282 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.732139    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.732282 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.732164    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.732567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.732545    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hbr62\""
Sep 17 16:19:03.734566 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.734566 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.734566 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734508    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-cni-bin\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.734566 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovnkube-script-lib\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbtcn\" (UniqueName: \"kubernetes.io/projected/d12b72b5-0f10-4b23-a01a-f210a25796bc-kube-api-access-cbtcn\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7v2f\" (UniqueName: \"kubernetes.io/projected/e5aec1bf-1102-4a94-8953-5012ae95a82d-kube-api-access-q7v2f\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-kubelet\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-ovn\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66c88570-814c-4148-88c6-b4b18f6caf60-konnectivity-ca\") pod \"konnectivity-agent-zvmpq\" (UID: \"66c88570-814c-4148-88c6-b4b18f6caf60\") " pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.734835 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-systemd\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovnkube-config\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-log-socket\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.734994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8q7\" (UniqueName: \"kubernetes.io/projected/e84097a3-915a-4787-a984-d2c92e853e0e-kube-api-access-gg8q7\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovn-node-metrics-cert\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-cni-netd\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-env-overrides\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-system-cni-dir\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5aec1bf-1102-4a94-8953-5012ae95a82d-iptables-alerter-script\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-systemd-units\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735271    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-slash\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-run-netns\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.735312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-node-log\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.736068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66c88570-814c-4148-88c6-b4b18f6caf60-agent-certs\") pod \"konnectivity-agent-zvmpq\" (UID: \"66c88570-814c-4148-88c6-b4b18f6caf60\") " pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.736068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-cnibin\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.736068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5aec1bf-1102-4a94-8953-5012ae95a82d-host-slash\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.736068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735448    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-var-lib-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.736068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-etc-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.736068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.735610    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 16:19:03.737505 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.737481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.737797 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.737774    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n9xfl\""
Sep 17 16:19:03.737896 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.737785    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.737896 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.737888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.738328 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.738312    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 16:19:03.740343 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.740320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 16:19:03.740721 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.740703    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sbjz9\""
Sep 17 16:19:03.740870 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.740847    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:03.740955 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.740918    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:03.742943 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.742923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.745724 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.745585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.745724 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.745650    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:03.746872 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.746852    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 16:19:03.747189 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.747171    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-47hlr\""
Sep 17 16:19:03.747400 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.747382    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 16:19:03.747648 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.747622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 16:19:03.762818 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.762799    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5bws8"
Sep 17 16:19:03.775848 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.775126    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5bws8"
Sep 17 16:19:03.822139 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.822118    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 16:19:03.835652 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-log-socket\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.835778 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835659    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.835778 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8q7\" (UniqueName: \"kubernetes.io/projected/e84097a3-915a-4787-a984-d2c92e853e0e-kube-api-access-gg8q7\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.835778 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-cni-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.835778 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-etc-kubernetes\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-log-socket\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-netns\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835860    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-cni-netd\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5aec1bf-1102-4a94-8953-5012ae95a82d-iptables-alerter-script\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9824dbfb-2fc9-4676-85e7-935284479f67-cni-binary-copy\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-cni-bin\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.835974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-cni-netd\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.835981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9824dbfb-2fc9-4676-85e7-935284479f67-multus-daemon-config\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysconfig\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-etc-selinux\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-run-netns\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-node-log\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-multus-certs\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-run-netns\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9wz\" (UniqueName: \"kubernetes.io/projected/b9f055da-addd-48a6-b837-9becc8d45ed2-kube-api-access-6s9wz\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-node-log\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-system-cni-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65s5g\" (UniqueName: \"kubernetes.io/projected/3979f2d0-d1ab-466e-8016-c79da49a3261-kube-api-access-65s5g\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-cni-bin\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-cni-bin\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.836323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7v2f\" (UniqueName: \"kubernetes.io/projected/e5aec1bf-1102-4a94-8953-5012ae95a82d-kube-api-access-q7v2f\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-kubelet\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-kubernetes\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-tuned\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836388    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5aec1bf-1102-4a94-8953-5012ae95a82d-iptables-alerter-script\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-kubelet\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836501    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-kubelet\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmgfd\" (UniqueName: \"kubernetes.io/projected/9824dbfb-2fc9-4676-85e7-935284479f67-kube-api-access-rmgfd\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-modprobe-d\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-run\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-socket-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovnkube-config\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llgh8\" (UniqueName: \"kubernetes.io/projected/fb2bcc30-f652-4940-86fb-dcc30bee1e11-kube-api-access-llgh8\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-socket-dir-parent\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836744    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-sys\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837009 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-device-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c87a9f8-de64-442a-9e45-41b6448a2840-dbus\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbe7c5d-6104-42d8-beee-163d4d2a8953-tmp-dir\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovn-node-metrics-cert\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c87a9f8-de64-442a-9e45-41b6448a2840-kubelet-config\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.836940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837031    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-cni-multus\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-hostroot\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837079    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysctl-d\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-env-overrides\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-system-cni-dir\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovnkube-config\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-systemd\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3979f2d0-d1ab-466e-8016-c79da49a3261-tmp\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-system-cni-dir\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-sys-fs\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.837801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837282    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-systemd-units\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-slash\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-systemd-units\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66c88570-814c-4148-88c6-b4b18f6caf60-agent-certs\") pod \"konnectivity-agent-zvmpq\" (UID: \"66c88570-814c-4148-88c6-b4b18f6caf60\") " pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837376    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-slash\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-cnibin\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5aec1bf-1102-4a94-8953-5012ae95a82d-host-slash\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2kll\" (UniqueName: \"kubernetes.io/projected/9bbe7c5d-6104-42d8-beee-163d4d2a8953-kube-api-access-r2kll\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-env-overrides\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-lib-modules\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9f055da-addd-48a6-b837-9becc8d45ed2-serviceca\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-cnibin\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5aec1bf-1102-4a94-8953-5012ae95a82d-host-slash\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837564    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-var-lib-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-etc-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-var-lib-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.838617 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837620    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-etc-openvswitch\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837672    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9bbe7c5d-6104-42d8-beee-163d4d2a8953-hosts-file\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppp6n\" (UniqueName: \"kubernetes.io/projected/bfcbb477-dfc0-476a-9379-d0f9383cf725-kube-api-access-ppp6n\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f055da-addd-48a6-b837-9becc8d45ed2-host\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovnkube-script-lib\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbtcn\" (UniqueName: \"kubernetes.io/projected/d12b72b5-0f10-4b23-a01a-f210a25796bc-kube-api-access-cbtcn\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e84097a3-915a-4787-a984-d2c92e853e0e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-k8s-cni-cncf-io\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837856    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysctl-conf\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837878    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-ovn\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66c88570-814c-4148-88c6-b4b18f6caf60-konnectivity-ca\") pod \"konnectivity-agent-zvmpq\" (UID: \"66c88570-814c-4148-88c6-b4b18f6caf60\") " pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.837983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-ovn\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-cnibin\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-conf-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-var-lib-kubelet\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-systemd\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-host\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-cni-binary-copy\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838179    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-registration-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838213    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d12b72b5-0f10-4b23-a01a-f210a25796bc-run-systemd\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838344    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovnkube-script-lib\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.838576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/66c88570-814c-4148-88c6-b4b18f6caf60-konnectivity-ca\") pod \"konnectivity-agent-zvmpq\" (UID: \"66c88570-814c-4148-88c6-b4b18f6caf60\") " pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.839036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.839935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.839343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e84097a3-915a-4787-a984-d2c92e853e0e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.841525 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.841495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d12b72b5-0f10-4b23-a01a-f210a25796bc-ovn-node-metrics-cert\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.841675 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.841657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/66c88570-814c-4148-88c6-b4b18f6caf60-agent-certs\") pod \"konnectivity-agent-zvmpq\" (UID: \"66c88570-814c-4148-88c6-b4b18f6caf60\") " pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:03.849356 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.849335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8q7\" (UniqueName: \"kubernetes.io/projected/e84097a3-915a-4787-a984-d2c92e853e0e-kube-api-access-gg8q7\") pod \"multus-additional-cni-plugins-p4bdq\" (UID: \"e84097a3-915a-4787-a984-d2c92e853e0e\") " pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:03.849610 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.849586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7v2f\" (UniqueName: \"kubernetes.io/projected/e5aec1bf-1102-4a94-8953-5012ae95a82d-kube-api-access-q7v2f\") pod \"iptables-alerter-4skrg\" (UID: \"e5aec1bf-1102-4a94-8953-5012ae95a82d\") " pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:03.850098 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.850074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbtcn\" (UniqueName: \"kubernetes.io/projected/d12b72b5-0f10-4b23-a01a-f210a25796bc-kube-api-access-cbtcn\") pod \"ovnkube-node-wxgq2\" (UID: \"d12b72b5-0f10-4b23-a01a-f210a25796bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:03.856203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.856158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal" event={"ID":"b0b7dfb22338a242f82fb89abf533158","Type":"ContainerStarted","Data":"d2c6bf1bf9f291653aa52a04501210d64bd5cc3a30f1dc13573cb195cdaf4a9a"}
Sep 17 16:19:03.857631 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.857606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"f2d3e7ffff061ae8160402b23c744e28","Type":"ContainerStarted","Data":"f73a55bc7710358f3bd58515dbe63c2d4b4a3a2d2bc81cea7e3f73586e89c9f0"}
Sep 17 16:19:03.938565 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysctl-d\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-systemd\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3979f2d0-d1ab-466e-8016-c79da49a3261-tmp\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-sys-fs\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2kll\" (UniqueName: \"kubernetes.io/projected/9bbe7c5d-6104-42d8-beee-163d4d2a8953-kube-api-access-r2kll\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-lib-modules\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938679    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-systemd\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-sys-fs\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.938746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938730    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9f055da-addd-48a6-b837-9becc8d45ed2-serviceca\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysctl-d\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9bbe7c5d-6104-42d8-beee-163d4d2a8953-hosts-file\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppp6n\" (UniqueName: \"kubernetes.io/projected/bfcbb477-dfc0-476a-9379-d0f9383cf725-kube-api-access-ppp6n\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938820    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-lib-modules\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f055da-addd-48a6-b837-9becc8d45ed2-host\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-k8s-cni-cncf-io\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9bbe7c5d-6104-42d8-beee-163d4d2a8953-hosts-file\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938910    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysctl-conf\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-k8s-cni-cncf-io\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938958    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f055da-addd-48a6-b837-9becc8d45ed2-host\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.938967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-cnibin\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-conf-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-cnibin\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-var-lib-kubelet\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-conf-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:03.939095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-host\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-registration-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-var-lib-kubelet\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-cni-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-etc-kubernetes\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939178    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-netns\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysctl-conf\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-host\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9f055da-addd-48a6-b837-9becc8d45ed2-serviceca\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939232    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-registration-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939242    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-netns\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939244    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-etc-kubernetes\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9824dbfb-2fc9-4676-85e7-935284479f67-cni-binary-copy\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-cni-bin\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9824dbfb-2fc9-4676-85e7-935284479f67-multus-daemon-config\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysconfig\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-cni-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-etc-selinux\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.940133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-multus-certs\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939436    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-sysconfig\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9wz\" (UniqueName: \"kubernetes.io/projected/b9f055da-addd-48a6-b837-9becc8d45ed2-kube-api-access-6s9wz\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-run-multus-certs\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-cni-bin\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-system-cni-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939516    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-etc-selinux\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65s5g\" (UniqueName: \"kubernetes.io/projected/3979f2d0-d1ab-466e-8016-c79da49a3261-kube-api-access-65s5g\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-kubelet\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-kubernetes\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-tuned\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-system-cni-dir\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939633    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-kubelet\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:03.941045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-kubernetes\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmgfd\" (UniqueName: \"kubernetes.io/projected/9824dbfb-2fc9-4676-85e7-935284479f67-kube-api-access-rmgfd\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-modprobe-d\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-run\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-socket-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.939788    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llgh8\" (UniqueName: \"kubernetes.io/projected/fb2bcc30-f652-4940-86fb-dcc30bee1e11-kube-api-access-llgh8\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-socket-dir-parent\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.939900    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:04.439875013 +0000 UTC m=+3.056770835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-multus-socket-dir-parent\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939921    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9824dbfb-2fc9-4676-85e7-935284479f67-cni-binary-copy\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.939938    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.939951    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-run\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.940019    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:04.439990621 +0000 UTC m=+3.056886426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-socket-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940056    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-modprobe-d\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-sys\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.941885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-device-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c87a9f8-de64-442a-9e45-41b6448a2840-dbus\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3979f2d0-d1ab-466e-8016-c79da49a3261-sys\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c87a9f8-de64-442a-9e45-41b6448a2840-dbus\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bfcbb477-dfc0-476a-9379-d0f9383cf725-device-dir\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbe7c5d-6104-42d8-beee-163d4d2a8953-tmp-dir\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c87a9f8-de64-442a-9e45-41b6448a2840-kubelet-config\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c87a9f8-de64-442a-9e45-41b6448a2840-kubelet-config\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9824dbfb-2fc9-4676-85e7-935284479f67-multus-daemon-config\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940498    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-cni-multus\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-host-var-lib-cni-multus\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bbe7c5d-6104-42d8-beee-163d4d2a8953-tmp-dir\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-hostroot\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.940616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9824dbfb-2fc9-4676-85e7-935284479f67-hostroot\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.941996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3979f2d0-d1ab-466e-8016-c79da49a3261-tmp\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.942611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.942047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3979f2d0-d1ab-466e-8016-c79da49a3261-etc-tuned\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.946685 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.946659    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:03.946685 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.946684    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:03.946836 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.946698    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:03.946836 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:03.946766    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:04.446743077 +0000 UTC m=+3.063638902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:03.950154 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.950127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppp6n\" (UniqueName: \"kubernetes.io/projected/bfcbb477-dfc0-476a-9379-d0f9383cf725-kube-api-access-ppp6n\") pod \"aws-ebs-csi-driver-node-mj49w\" (UID: \"bfcbb477-dfc0-476a-9379-d0f9383cf725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:03.950387 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.950367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmgfd\" (UniqueName: \"kubernetes.io/projected/9824dbfb-2fc9-4676-85e7-935284479f67-kube-api-access-rmgfd\") pod \"multus-bqtzg\" (UID: \"9824dbfb-2fc9-4676-85e7-935284479f67\") " pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:03.950483 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.950417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9wz\" (UniqueName: \"kubernetes.io/projected/b9f055da-addd-48a6-b837-9becc8d45ed2-kube-api-access-6s9wz\") pod \"node-ca-c7bhg\" (UID: \"b9f055da-addd-48a6-b837-9becc8d45ed2\") " pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:03.950703 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.950678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2kll\" (UniqueName: \"kubernetes.io/projected/9bbe7c5d-6104-42d8-beee-163d4d2a8953-kube-api-access-r2kll\") pod \"node-resolver-ftr9x\" (UID: \"9bbe7c5d-6104-42d8-beee-163d4d2a8953\") " pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:03.950966 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.950870    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65s5g\" (UniqueName: \"kubernetes.io/projected/3979f2d0-d1ab-466e-8016-c79da49a3261-kube-api-access-65s5g\") pod \"tuned-7bzn5\" (UID: \"3979f2d0-d1ab-466e-8016-c79da49a3261\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:03.953888 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:03.953868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llgh8\" (UniqueName: \"kubernetes.io/projected/fb2bcc30-f652-4940-86fb-dcc30bee1e11-kube-api-access-llgh8\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:04.027366 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.027331    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p4bdq"
Sep 17 16:19:04.036367 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.036340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4skrg"
Sep 17 16:19:04.039729 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.039697    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84097a3_915a_4787_a984_d2c92e853e0e.slice/crio-4ab1d075bbc2b1e2730113fd60388d0fcad13e225617914f9dc33e237eeea68a WatchSource:0}: Error finding container 4ab1d075bbc2b1e2730113fd60388d0fcad13e225617914f9dc33e237eeea68a: Status 404 returned error can't find the container with id 4ab1d075bbc2b1e2730113fd60388d0fcad13e225617914f9dc33e237eeea68a
Sep 17 16:19:04.043817 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.043734    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:04.047386 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.047357    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5aec1bf_1102_4a94_8953_5012ae95a82d.slice/crio-b5034902260773fd8c9860de08df0a2eb511c291b355c7629ba2edaab99b66a0 WatchSource:0}: Error finding container b5034902260773fd8c9860de08df0a2eb511c291b355c7629ba2edaab99b66a0: Status 404 returned error can't find the container with id b5034902260773fd8c9860de08df0a2eb511c291b355c7629ba2edaab99b66a0
Sep 17 16:19:04.049757 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.049737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:04.053757 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.053725    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12b72b5_0f10_4b23_a01a_f210a25796bc.slice/crio-62ff98f4c9e727a62331c38b55bf722d5153a7a279f768f05c0b528f44dc19ab WatchSource:0}: Error finding container 62ff98f4c9e727a62331c38b55bf722d5153a7a279f768f05c0b528f44dc19ab: Status 404 returned error can't find the container with id 62ff98f4c9e727a62331c38b55bf722d5153a7a279f768f05c0b528f44dc19ab
Sep 17 16:19:04.056538 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.056516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftr9x"
Sep 17 16:19:04.059958 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.059933    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c88570_814c_4148_88c6_b4b18f6caf60.slice/crio-5ee3c63c37ae3afbd7fb959547c1a25cd5c747b71a550fc2e36b56d91d343d56 WatchSource:0}: Error finding container 5ee3c63c37ae3afbd7fb959547c1a25cd5c747b71a550fc2e36b56d91d343d56: Status 404 returned error can't find the container with id 5ee3c63c37ae3afbd7fb959547c1a25cd5c747b71a550fc2e36b56d91d343d56
Sep 17 16:19:04.065765 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.065739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bzn5"
Sep 17 16:19:04.068844 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.068817    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbe7c5d_6104_42d8_beee_163d4d2a8953.slice/crio-0163fc5e582dc1d032aeebc3cb458db73fab808e09a35b915daa22867d1fc881 WatchSource:0}: Error finding container 0163fc5e582dc1d032aeebc3cb458db73fab808e09a35b915daa22867d1fc881: Status 404 returned error can't find the container with id 0163fc5e582dc1d032aeebc3cb458db73fab808e09a35b915daa22867d1fc881
Sep 17 16:19:04.071793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.071621    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w"
Sep 17 16:19:04.076744 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.076723    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3979f2d0_d1ab_466e_8016_c79da49a3261.slice/crio-17c1a8202d40613b615d6108dd61154b9bb6f8bd4cb7a3f1eb6cb1f6b2d0b77b WatchSource:0}: Error finding container 17c1a8202d40613b615d6108dd61154b9bb6f8bd4cb7a3f1eb6cb1f6b2d0b77b: Status 404 returned error can't find the container with id 17c1a8202d40613b615d6108dd61154b9bb6f8bd4cb7a3f1eb6cb1f6b2d0b77b
Sep 17 16:19:04.078745 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.078595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bqtzg"
Sep 17 16:19:04.084755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.084575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c7bhg"
Sep 17 16:19:04.092199 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:04.092173    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9824dbfb_2fc9_4676_85e7_935284479f67.slice/crio-f52ba1f1a8a3eba7fd1ddef6b0bb0c7cf668905ab400807c37292b54bf1ba211 WatchSource:0}: Error finding container f52ba1f1a8a3eba7fd1ddef6b0bb0c7cf668905ab400807c37292b54bf1ba211: Status 404 returned error can't find the container with id f52ba1f1a8a3eba7fd1ddef6b0bb0c7cf668905ab400807c37292b54bf1ba211
Sep 17 16:19:04.443929 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.443585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:04.443929 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.443638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:04.443929 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.443771    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:04.443929 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.443766    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:04.443929 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.443835    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:05.443815203 +0000 UTC m=+4.060711024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:04.443929 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.443855    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:05.443844883 +0000 UTC m=+4.060740688 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:04.544626 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.544590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:04.544804 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.544782    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:04.544874 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.544806    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:04.544874 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.544816    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:04.544948 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.544876    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:05.544860132 +0000 UTC m=+4.161755937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:04.661115 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.661076    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:04.779058 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.778922    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:14:04 +0000 UTC" deadline="2028-04-15 19:54:06.219583002 +0000 UTC"
Sep 17 16:19:04.779058 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.778989    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13827h35m1.440597929s"
Sep 17 16:19:04.851792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.851760    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:04.851965 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:04.851882    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:04.860746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.860716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w" event={"ID":"bfcbb477-dfc0-476a-9379-d0f9383cf725","Type":"ContainerStarted","Data":"64462231492a49eb97384577016ae27ea63edeeec3685be57aeef5fd9f0d303c"}
Sep 17 16:19:04.862019 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.861989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bzn5" event={"ID":"3979f2d0-d1ab-466e-8016-c79da49a3261","Type":"ContainerStarted","Data":"17c1a8202d40613b615d6108dd61154b9bb6f8bd4cb7a3f1eb6cb1f6b2d0b77b"}
Sep 17 16:19:04.863392 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.863364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zvmpq" event={"ID":"66c88570-814c-4148-88c6-b4b18f6caf60","Type":"ContainerStarted","Data":"5ee3c63c37ae3afbd7fb959547c1a25cd5c747b71a550fc2e36b56d91d343d56"}
Sep 17 16:19:04.864815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.864789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"62ff98f4c9e727a62331c38b55bf722d5153a7a279f768f05c0b528f44dc19ab"}
Sep 17 16:19:04.866134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.866106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c7bhg" event={"ID":"b9f055da-addd-48a6-b837-9becc8d45ed2","Type":"ContainerStarted","Data":"7254b69dc5ffa5622fa68416364ac8d86fbbe133fa885883779f24998507fa55"}
Sep 17 16:19:04.867510 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.867475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftr9x" event={"ID":"9bbe7c5d-6104-42d8-beee-163d4d2a8953","Type":"ContainerStarted","Data":"0163fc5e582dc1d032aeebc3cb458db73fab808e09a35b915daa22867d1fc881"}
Sep 17 16:19:04.868935 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.868900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4skrg" event={"ID":"e5aec1bf-1102-4a94-8953-5012ae95a82d","Type":"ContainerStarted","Data":"b5034902260773fd8c9860de08df0a2eb511c291b355c7629ba2edaab99b66a0"}
Sep 17 16:19:04.870337 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.870314    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerStarted","Data":"4ab1d075bbc2b1e2730113fd60388d0fcad13e225617914f9dc33e237eeea68a"}
Sep 17 16:19:04.871670 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:04.871650    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqtzg" event={"ID":"9824dbfb-2fc9-4676-85e7-935284479f67","Type":"ContainerStarted","Data":"f52ba1f1a8a3eba7fd1ddef6b0bb0c7cf668905ab400807c37292b54bf1ba211"}
Sep 17 16:19:05.360650 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.360455    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 16:19:05.453105 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.453066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:05.453254 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.453117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:05.453334 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.453306    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:05.453403 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.453377    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:07.453356243 +0000 UTC m=+6.070252063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:05.453854 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.453829    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:05.453962 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.453893    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:07.453876599 +0000 UTC m=+6.070772416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:05.554610 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.554570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:05.554937 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.554915    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:05.555011 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.554945    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:05.555011 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.554959    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:05.555133 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.555023    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:07.555004032 +0000 UTC m=+6.171899850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:05.779347 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.779305    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 16:14:04 +0000 UTC" deadline="2028-04-11 20:31:22.951044041 +0000 UTC"
Sep 17 16:19:05.779347 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.779346    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13732h12m17.171703806s"
Sep 17 16:19:05.855348 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.854244    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:05.855348 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.854395    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:05.855348 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:05.855151    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:05.855348 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:05.855250    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:06.851686 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:06.851149    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:06.851686 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:06.851282    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:06.907295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:06.907252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal" event={"ID":"b0b7dfb22338a242f82fb89abf533158","Type":"ContainerStarted","Data":"6a1f02d3ef2dafa0966169bc9763b9f4bccd814991294a1cc649403118054c44"}
Sep 17 16:19:06.924472 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:06.924397    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-87.ec2.internal" podStartSLOduration=3.924374246 podStartE2EDuration="3.924374246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:06.924141151 +0000 UTC m=+5.541036977" watchObservedRunningTime="2026-09-17 16:19:06.924374246 +0000 UTC m=+5.541270073"
Sep 17 16:19:07.472904 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:07.472110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:07.472904 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:07.472157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:07.472904 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.472304    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:07.472904 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.472369    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:11.472350195 +0000 UTC m=+10.089245999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:07.472904 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.472808    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:07.472904 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.472866    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:11.472849664 +0000 UTC m=+10.089745490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:07.573322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:07.572600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:07.573322 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.572840    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:07.573322 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.572861    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:07.573322 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.572874    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:07.573322 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.572931    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:11.572911636 +0000 UTC m=+10.189807464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:07.851225 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:07.851142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:07.851397 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.851287    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:07.851780 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:07.851755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:07.852206 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:07.851876    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:07.917858 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:07.917775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"f2d3e7ffff061ae8160402b23c744e28","Type":"ContainerStarted","Data":"b6c46e354b695ccb7703bd69dff8bca56be1ad79b19120dce4e2f930161d80ef"}
Sep 17 16:19:08.851435 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:08.851383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:08.851619 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:08.851536    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:09.854833 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:09.854797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:09.855259 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:09.854848    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:09.855259 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:09.854918    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:09.855259 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:09.855047    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:10.851189 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:10.851156    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:10.851358 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:10.851283    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:10.924551 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:10.924522    2582 generic.go:356] "Generic (PLEG): container finished" podID="f2d3e7ffff061ae8160402b23c744e28" containerID="b6c46e354b695ccb7703bd69dff8bca56be1ad79b19120dce4e2f930161d80ef" exitCode=0
Sep 17 16:19:10.924876 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:10.924567    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"f2d3e7ffff061ae8160402b23c744e28","Type":"ContainerDied","Data":"b6c46e354b695ccb7703bd69dff8bca56be1ad79b19120dce4e2f930161d80ef"}
Sep 17 16:19:11.506612 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:11.506575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:11.506612 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:11.506613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:11.506863 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.506741    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:11.506863 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.506746    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:11.506863 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.506811    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:19.506794163 +0000 UTC m=+18.123689986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:11.506863 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.506830    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:19.506821067 +0000 UTC m=+18.123716878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:11.607551 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:11.607519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:11.607750 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.607715    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:11.607750 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.607738    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:11.607750 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.607752    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:11.607946 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.607813    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:19.60779664 +0000 UTC m=+18.224692440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:11.852555 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:11.852474    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:11.852717 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.852600    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:11.852717 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:11.852628    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:11.852848 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:11.852759    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:12.852055 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:12.852022    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:12.852514 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:12.852157    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:13.851480 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:13.851441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:13.851670 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:13.851484    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:13.851670 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:13.851597    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:13.851782 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:13.851707    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:14.852103 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.852026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:14.852591 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:14.852144    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:14.935468 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.935420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" event={"ID":"f2d3e7ffff061ae8160402b23c744e28","Type":"ContainerStarted","Data":"7c159124a1a2c10dde382a1eac4d5024f3941d34cce2fa4709db2331b21e8566"}
Sep 17 16:19:14.937466 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.937403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w" event={"ID":"bfcbb477-dfc0-476a-9379-d0f9383cf725","Type":"ContainerStarted","Data":"2b35cace6caa79b4571dbe18a8d885d890183c1f078b0a26e3fc7085f460dd06"}
Sep 17 16:19:14.939199 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.939176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bzn5" event={"ID":"3979f2d0-d1ab-466e-8016-c79da49a3261","Type":"ContainerStarted","Data":"8cb30335f6f27d2ed747a7986d847e4392d6a82ef24354ed4ccbdd6cf5b8c2f7"}
Sep 17 16:19:14.942254 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.942228    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zvmpq" event={"ID":"66c88570-814c-4148-88c6-b4b18f6caf60","Type":"ContainerStarted","Data":"975ea8ff5113c444fdf5816b2928cc40f8ed8e2588bf9a549439b705d6c75438"}
Sep 17 16:19:14.945522 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.945498    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c7bhg" event={"ID":"b9f055da-addd-48a6-b837-9becc8d45ed2","Type":"ContainerStarted","Data":"584f36ff966cb557e2d57e1f3c9517f77ae572a534f9e0f69bb21d27ab4c7b15"}
Sep 17 16:19:14.947651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.947603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftr9x" event={"ID":"9bbe7c5d-6104-42d8-beee-163d4d2a8953","Type":"ContainerStarted","Data":"fb8590c0a50feeb525b2c9b06fc5f15f0c16c6fa330f8944f1b723f35ee56792"}
Sep 17 16:19:14.949671 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.949650    2582 generic.go:356] "Generic (PLEG): container finished" podID="e84097a3-915a-4787-a984-d2c92e853e0e" containerID="8064635c6a66d6209b5524ba97aa7de8344617f11b9e8c4ea6d67a9dc461549d" exitCode=0
Sep 17 16:19:14.949793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:14.949682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerDied","Data":"8064635c6a66d6209b5524ba97aa7de8344617f11b9e8c4ea6d67a9dc461549d"}
Sep 17 16:19:15.000267 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.000227    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-87.ec2.internal" podStartSLOduration=12.000213816 podStartE2EDuration="12.000213816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:14.968621736 +0000 UTC m=+13.585517557" watchObservedRunningTime="2026-09-17 16:19:15.000213816 +0000 UTC m=+13.617109638"
Sep 17 16:19:15.045940 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.045892    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ftr9x" podStartSLOduration=2.768243105 podStartE2EDuration="13.045873994s" totalImagesPullingTime="10.277630889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:15.023097827 +0000 UTC m=+13.639993648" watchObservedRunningTime="2026-09-17 16:19:15.045873994 +0000 UTC m=+13.662769817"
Sep 17 16:19:15.046175 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.046155    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7bzn5" podStartSLOduration=2.739709477 podStartE2EDuration="13.046149491s" totalImagesPullingTime="10.306440014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:15.045997022 +0000 UTC m=+13.662892859" watchObservedRunningTime="2026-09-17 16:19:15.046149491 +0000 UTC m=+13.663045313"
Sep 17 16:19:15.063907 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.063856    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zvmpq" podStartSLOduration=2.7794454330000002 podStartE2EDuration="13.063840424s" totalImagesPullingTime="10.284394991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:15.063562852 +0000 UTC m=+13.680458675" watchObservedRunningTime="2026-09-17 16:19:15.063840424 +0000 UTC m=+13.680736247"
Sep 17 16:19:15.104408 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.104307    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c7bhg" podStartSLOduration=2.887325153 podStartE2EDuration="13.104293553s" totalImagesPullingTime="10.2169684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:15.103911716 +0000 UTC m=+13.720807540" watchObservedRunningTime="2026-09-17 16:19:15.104293553 +0000 UTC m=+13.721189375"
Sep 17 16:19:15.851948 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.851917    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:15.852129 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:15.852050    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:15.852129 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.852096    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:15.852560 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:15.852219    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:15.954742 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:15.954709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4skrg" event={"ID":"e5aec1bf-1102-4a94-8953-5012ae95a82d","Type":"ContainerStarted","Data":"ca5d27a02322c2fdf768e6d8c2ac574a61f70ae83c58bcffcbe55156e32c784e"}
Sep 17 16:19:16.261801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:16.261769    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 16:19:16.791590 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:16.791505    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T16:19:16.26179782Z","UUID":"179bc026-8bd1-413a-b50c-41ae6652abb7","Handler":null,"Name":"","Endpoint":""}
Sep 17 16:19:16.793296 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:16.793273    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 16:19:16.793447 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:16.793310    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 16:19:16.852457 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:16.852408    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:16.852848 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:16.852539    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:16.961111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:16.961078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w" event={"ID":"bfcbb477-dfc0-476a-9379-d0f9383cf725","Type":"ContainerStarted","Data":"33f05e6eee6fa08866fb25b50948fb8b4c2fba30e55f80dae747fc13f6992799"}
Sep 17 16:19:17.811406 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:17.811143    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:17.811891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:17.811866    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:17.832378 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:17.832324    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4skrg" podStartSLOduration=5.535627817 podStartE2EDuration="15.832304012s" totalImagesPullingTime="10.296676195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:16.979894923 +0000 UTC m=+15.596790747" watchObservedRunningTime="2026-09-17 16:19:17.832304012 +0000 UTC m=+16.449199835"
Sep 17 16:19:17.851450 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:17.851421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:17.851616 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:17.851553    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:17.851616 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:17.851586    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:17.851747 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:17.851713    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:18.851133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:18.851099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:18.851644 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:18.851239    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:19.573274 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:19.573240    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:19.573274 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:19.573277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:19.573600 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.573415    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:19.573600 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.573415    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:19.573600 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.573479    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:35.573461852 +0000 UTC m=+34.190357666 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:19.573600 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.573497    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:35.573487622 +0000 UTC m=+34.190383421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:19.674600 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:19.674516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:19.674796 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.674697    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:19.674796 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.674727    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:19.674796 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.674741    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:19.674953 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.674808    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:35.674788563 +0000 UTC m=+34.291684369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:19.852246 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:19.852164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:19.852746 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:19.852164    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:19.852746 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.852301    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:19.852746 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:19.852410    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:20.851513 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:20.851475    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:20.851690 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:20.851651    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:21.852121 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:21.852087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:21.852688 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:21.852217    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:21.852688 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:21.852463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:21.852688 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:21.852555    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:22.851346 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:22.851314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:22.851531 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:22.851437    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:23.851212 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:23.851172    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:23.851692 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:23.851181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:23.851692 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:23.851299    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:23.851692 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:23.851412    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:24.851637 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:24.851590    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:24.852166 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:24.851741    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:25.852088 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:25.851579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:25.852088 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:25.851715    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:25.852088 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:25.851777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:25.852088 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:25.851891    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:26.773287 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.773058    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:26.773457 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.773417    2582 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 16:19:26.774532 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.774312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zvmpq"
Sep 17 16:19:26.851900 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.851797    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:26.851961 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:26.851912    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:26.983432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.983353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"ddde109ea8d7bd6320a9d73de0de2e8053cf055e5aeeb784f2c5c671da27cc28"}
Sep 17 16:19:26.983991 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.983446    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"3743965a83951a0e1e4f958119c00b186010037eba08a5c764238a969c1ea6ca"}
Sep 17 16:19:26.983991 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.983485    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"8017ee5750b326a61995d43f8dc075ef9a8f6e0e933a14ae2a1554de540d7652"}
Sep 17 16:19:26.983991 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.983515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"25d5267b2c7413578d01bf3507a8f2487a002d402fdef76fffea6537571026f3"}
Sep 17 16:19:26.983991 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.983541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"242cbab57cfc0879eedc87bf0e6a6b5feb9e1ab8e70cd46c2d91046fd5edeaa1"}
Sep 17 16:19:26.983991 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.983578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"63f5ce31d43f6a305c28ad6f1289df2c358e241ae6d08a56a2f5d58c758165b2"}
Sep 17 16:19:26.985231 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.985207    2582 generic.go:356] "Generic (PLEG): container finished" podID="e84097a3-915a-4787-a984-d2c92e853e0e" containerID="fdd6a4b03fdc797ef1841b57c685a67f93b11aa01a42b4d0faf1a90d10203a3b" exitCode=0
Sep 17 16:19:26.985320 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.985289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerDied","Data":"fdd6a4b03fdc797ef1841b57c685a67f93b11aa01a42b4d0faf1a90d10203a3b"}
Sep 17 16:19:26.986955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.986929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bqtzg" event={"ID":"9824dbfb-2fc9-4676-85e7-935284479f67","Type":"ContainerStarted","Data":"4ff81a004834f7e931b9afb11c2e4ef6c835015cded7f5c07dc055c376c5d890"}
Sep 17 16:19:26.989281 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:26.989247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w" event={"ID":"bfcbb477-dfc0-476a-9379-d0f9383cf725","Type":"ContainerStarted","Data":"a003457a1aab9ef48e4236094bb399ad5625a47376d017b19ecdd481cad2f762"}
Sep 17 16:19:27.025380 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:27.025337    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bqtzg" podStartSLOduration=2.610810516 podStartE2EDuration="25.025321342s" totalImagesPullingTime="22.414510826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:27.025082174 +0000 UTC m=+25.641977996" watchObservedRunningTime="2026-09-17 16:19:27.025321342 +0000 UTC m=+25.642217164"
Sep 17 16:19:27.851651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:27.851569    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:27.851829 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:27.851708    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:27.851829 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:27.851757    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:27.851914 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:27.851860    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:28.851290 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:28.851111    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:28.851702 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:28.851357    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:29.851288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:29.851221    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:29.851288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:29.851238    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:29.851767 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:29.851330    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:29.851767 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:29.851464    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:29.998669 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:29.998634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"4d70bfa2a6cf6735b0b59fd91a9214021792701f08ded7937afedbf8e77a63e8"}
Sep 17 16:19:30.000657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:30.000628    2582 generic.go:356] "Generic (PLEG): container finished" podID="e84097a3-915a-4787-a984-d2c92e853e0e" containerID="348fd97b0e424621b09053bf875e39484b22669f67c8d14491c4db3e95f588a4" exitCode=0
Sep 17 16:19:30.000657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:30.000658    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerDied","Data":"348fd97b0e424621b09053bf875e39484b22669f67c8d14491c4db3e95f588a4"}
Sep 17 16:19:30.028111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:30.028064    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mj49w" podStartSLOduration=6.011971362 podStartE2EDuration="28.028050224s" totalImagesPullingTime="22.016078862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:27.045384205 +0000 UTC m=+25.662280027" watchObservedRunningTime="2026-09-17 16:19:30.028050224 +0000 UTC m=+28.644946049"
Sep 17 16:19:30.851757 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:30.851728    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:30.852105 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:30.851835    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:31.854274 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:31.854248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:31.854843 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:31.854342    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:31.854843 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:31.854410    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:31.854843 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:31.854617    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:32.008626 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.008590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" event={"ID":"d12b72b5-0f10-4b23-a01a-f210a25796bc","Type":"ContainerStarted","Data":"e9bd016360d2222ae4bc51422e1a57c56ddd503e9a834b8ee9780e4912bdfa03"}
Sep 17 16:19:32.008813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.008781    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:32.008869 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.008845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:32.008933 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.008919    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:32.011795 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.011768    2582 generic.go:356] "Generic (PLEG): container finished" podID="e84097a3-915a-4787-a984-d2c92e853e0e" containerID="e26ebf0ce2abd6d135bb084d9d51ab344a97a545e7c2ec8a9197287556b4d9ca" exitCode=0
Sep 17 16:19:32.011913 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.011819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerDied","Data":"e26ebf0ce2abd6d135bb084d9d51ab344a97a545e7c2ec8a9197287556b4d9ca"}
Sep 17 16:19:32.025639 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.025618    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:32.025788 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.025773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:19:32.043122 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.043084    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2" podStartSLOduration=7.588622143 podStartE2EDuration="30.043071819s" totalImagesPullingTime="22.454449676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:32.042518371 +0000 UTC m=+30.659414190" watchObservedRunningTime="2026-09-17 16:19:32.043071819 +0000 UTC m=+30.659967667"
Sep 17 16:19:32.851723 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:32.851677    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:32.851881 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:32.851826    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:33.364513 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:33.364477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k6kvk"]
Sep 17 16:19:33.365067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:33.364598    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:33.365067 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:33.364714    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:33.368040 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:33.368005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nxrgg"]
Sep 17 16:19:33.368168 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:33.368123    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:33.368248 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:33.368206    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:33.368769 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:33.368750    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kn6qg"]
Sep 17 16:19:33.368881 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:33.368836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:33.368954 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:33.368919    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:34.851428 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:34.851398    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:34.851870 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:34.851400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:34.851870 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:34.851519    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:34.851870 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:34.851400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:34.851870 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:34.851574    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:34.851870 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:34.851640    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:35.592943 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:35.592904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:35.592943 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:35.592944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:35.593116 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.593037    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:35.593116 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.593040    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:35.593116 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.593090    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:20:07.593076104 +0000 UTC m=+66.209971908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 16:19:35.593116 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.593102    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret podName:5c87a9f8-de64-442a-9e45-41b6448a2840 nodeName:}" failed. No retries permitted until 2026-09-17 16:20:07.593096486 +0000 UTC m=+66.209992286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret") pod "global-pull-secret-syncer-k6kvk" (UID: "5c87a9f8-de64-442a-9e45-41b6448a2840") : object "kube-system"/"original-pull-secret" not registered
Sep 17 16:19:35.694225 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:35.694151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:35.694358 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.694319    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 16:19:35.694358 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.694338    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 16:19:35.694358 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.694347    2582 projected.go:196] Error preparing data for projected volume kube-api-access-skkv7 for pod openshift-network-diagnostics/network-check-target-nxrgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:35.694497 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:35.694409    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7 podName:ba28ffc6-2b98-4648-aba1-a0e843065769 nodeName:}" failed. No retries permitted until 2026-09-17 16:20:07.694376311 +0000 UTC m=+66.311272110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-skkv7" (UniqueName: "kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7") pod "network-check-target-nxrgg" (UID: "ba28ffc6-2b98-4648-aba1-a0e843065769") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 16:19:36.852133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:36.852090    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:36.852589 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:36.852097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:36.852589 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:36.852097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:36.852589 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:36.852274    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:36.852589 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:36.852347    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:36.852589 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:36.852466    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:38.031489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:38.031414    2582 generic.go:356] "Generic (PLEG): container finished" podID="e84097a3-915a-4787-a984-d2c92e853e0e" containerID="c0683b6bea16c08e71c4fc862d6079855a0305b78980ae5d8036cceb9356f3f9" exitCode=0
Sep 17 16:19:38.031489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:38.031452    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerDied","Data":"c0683b6bea16c08e71c4fc862d6079855a0305b78980ae5d8036cceb9356f3f9"}
Sep 17 16:19:38.851447 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:38.851258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:38.851708 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:38.851258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:38.851708 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:38.851519    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kn6qg" podUID="fb2bcc30-f652-4940-86fb-dcc30bee1e11"
Sep 17 16:19:38.851708 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:38.851613    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6kvk" podUID="5c87a9f8-de64-442a-9e45-41b6448a2840"
Sep 17 16:19:38.851708 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:38.851258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:38.851866 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:38.851707    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxrgg" podUID="ba28ffc6-2b98-4648-aba1-a0e843065769"
Sep 17 16:19:39.036666 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:39.036631    2582 generic.go:356] "Generic (PLEG): container finished" podID="e84097a3-915a-4787-a984-d2c92e853e0e" containerID="0a05c10232a81bb17e13efefed8eed4185766824b5af1710547c750297c23d11" exitCode=0
Sep 17 16:19:39.037028 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:39.036697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerDied","Data":"0a05c10232a81bb17e13efefed8eed4185766824b5af1710547c750297c23d11"}
Sep 17 16:19:40.042120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.042084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" event={"ID":"e84097a3-915a-4787-a984-d2c92e853e0e","Type":"ContainerStarted","Data":"2798de2774988c354123c73e34055415022cf5c0192c087f4826874a1f4989d6"}
Sep 17 16:19:40.069866 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.069811    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p4bdq" podStartSLOduration=7.033059202 podStartE2EDuration="38.069794892s" totalImagesPullingTime="31.03673569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:40.068541939 +0000 UTC m=+38.685437761" watchObservedRunningTime="2026-09-17 16:19:40.069794892 +0000 UTC m=+38.686690714"
Sep 17 16:19:40.114416 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.114377    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-87.ec2.internal" event="NodeReady"
Sep 17 16:19:40.114540 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.114510    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 16:19:40.176507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.176440    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7vpk7"]
Sep 17 16:19:40.200243 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.200219    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fg78m"]
Sep 17 16:19:40.200369 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.200334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.203057 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.203038    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 16:19:40.203182 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.203037    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hkm7f\""
Sep 17 16:19:40.203295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.203281    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 16:19:40.220325 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.220305    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vpk7"]
Sep 17 16:19:40.220446 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.220340    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fg78m"]
Sep 17 16:19:40.220497 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.220446    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.223314 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.223296    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 16:19:40.223419 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.223341    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 16:19:40.223419 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.223379    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 16:19:40.224037 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.224025    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5dq79\""
Sep 17 16:19:40.332520 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.332488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3357b42-4959-4ec0-afc5-f46447c539d7-tmp-dir\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.332642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.332544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjjbx\" (UniqueName: \"kubernetes.io/projected/f3357b42-4959-4ec0-afc5-f46447c539d7-kube-api-access-bjjbx\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.332642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.332564    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3357b42-4959-4ec0-afc5-f46447c539d7-config-volume\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.332642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.332605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/069ac91f-a50e-4868-bf37-739b1973f072-cert\") pod \"ingress-canary-fg78m\" (UID: \"069ac91f-a50e-4868-bf37-739b1973f072\") " pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.332642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.332622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.332786 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.332655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cfrx\" (UniqueName: \"kubernetes.io/projected/069ac91f-a50e-4868-bf37-739b1973f072-kube-api-access-9cfrx\") pod \"ingress-canary-fg78m\" (UID: \"069ac91f-a50e-4868-bf37-739b1973f072\") " pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.433861 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.433794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3357b42-4959-4ec0-afc5-f46447c539d7-tmp-dir\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.433972 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.433901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjjbx\" (UniqueName: \"kubernetes.io/projected/f3357b42-4959-4ec0-afc5-f46447c539d7-kube-api-access-bjjbx\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.433972 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.433936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3357b42-4959-4ec0-afc5-f46447c539d7-config-volume\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.433972 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.433963    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/069ac91f-a50e-4868-bf37-739b1973f072-cert\") pod \"ingress-canary-fg78m\" (UID: \"069ac91f-a50e-4868-bf37-739b1973f072\") " pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.434107 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.433983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.434107 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.434044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cfrx\" (UniqueName: \"kubernetes.io/projected/069ac91f-a50e-4868-bf37-739b1973f072-kube-api-access-9cfrx\") pod \"ingress-canary-fg78m\" (UID: \"069ac91f-a50e-4868-bf37-739b1973f072\") " pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.434107 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.434093    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3357b42-4959-4ec0-afc5-f46447c539d7-tmp-dir\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.434241 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:40.434170    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:19:40.434241 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:40.434240    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:40.93422122 +0000 UTC m=+39.551117036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:19:40.434575 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.434552    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3357b42-4959-4ec0-afc5-f46447c539d7-config-volume\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.438103 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.438083    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/069ac91f-a50e-4868-bf37-739b1973f072-cert\") pod \"ingress-canary-fg78m\" (UID: \"069ac91f-a50e-4868-bf37-739b1973f072\") " pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.449193 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.449168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjjbx\" (UniqueName: \"kubernetes.io/projected/f3357b42-4959-4ec0-afc5-f46447c539d7-kube-api-access-bjjbx\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.449277 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.449254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cfrx\" (UniqueName: \"kubernetes.io/projected/069ac91f-a50e-4868-bf37-739b1973f072-kube-api-access-9cfrx\") pod \"ingress-canary-fg78m\" (UID: \"069ac91f-a50e-4868-bf37-739b1973f072\") " pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.530182 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.530140    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fg78m"
Sep 17 16:19:40.852184 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.852113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:19:40.852184 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.852129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:19:40.852355 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.852243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:19:40.854246 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.854218    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fg78m"]
Sep 17 16:19:40.855815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.855701    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 16:19:40.855815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.855707    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bq92d\""
Sep 17 16:19:40.855976 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.855963    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 16:19:40.856903 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.856884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 16:19:40.856994 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.856929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxxrv\""
Sep 17 16:19:40.856994 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.856941    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 16:19:40.858235 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:19:40.858211    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069ac91f_a50e_4868_bf37_739b1973f072.slice/crio-902ddb34f2bb835f8a2257a66e7022a22896f1a89f49130430cdf5bbfa7527fe WatchSource:0}: Error finding container 902ddb34f2bb835f8a2257a66e7022a22896f1a89f49130430cdf5bbfa7527fe: Status 404 returned error can't find the container with id 902ddb34f2bb835f8a2257a66e7022a22896f1a89f49130430cdf5bbfa7527fe
Sep 17 16:19:40.936309 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:40.936288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:40.936471 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:40.936454    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:19:40.936525 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:40.936516    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:41.936500908 +0000 UTC m=+40.553396711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:19:41.045800 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:41.045760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fg78m" event={"ID":"069ac91f-a50e-4868-bf37-739b1973f072","Type":"ContainerStarted","Data":"902ddb34f2bb835f8a2257a66e7022a22896f1a89f49130430cdf5bbfa7527fe"}
Sep 17 16:19:41.944137 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:41.943939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:41.944331 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:41.944100    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:19:41.944331 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:41.944214    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:43.94419357 +0000 UTC m=+42.561089386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:19:43.960634 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:43.960602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:43.961024 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:43.960770    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:19:43.961024 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:43.960844    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:47.960823578 +0000 UTC m=+46.577719393 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:19:44.055719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:44.055632    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fg78m" event={"ID":"069ac91f-a50e-4868-bf37-739b1973f072","Type":"ContainerStarted","Data":"80d8fa929fc595aa91b96b1cc22af5e03cacfddfe95ca636f071d6faa3a47e5b"}
Sep 17 16:19:44.074042 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:44.073994    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fg78m" podStartSLOduration=1.133431753 podStartE2EDuration="4.073978273s" totalImagesPullingTime="2.94054652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:19:44.073310322 +0000 UTC m=+42.690206146" watchObservedRunningTime="2026-09-17 16:19:44.073978273 +0000 UTC m=+42.690874097"
Sep 17 16:19:47.989654 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:47.989618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:47.990197 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:47.989736    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:19:47.990197 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:47.989806    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:19:55.989785775 +0000 UTC m=+54.606681591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:19:56.036582 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:19:56.036536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:19:56.037286 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:56.036681    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:19:56.037286 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:19:56.036753    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:20:12.03673412 +0000 UTC m=+70.653629935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:20:04.027227 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:04.027197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wxgq2"
Sep 17 16:20:07.615799 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.615756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:20:07.615799 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.615795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:20:07.619043 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.619023    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 16:20:07.619599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.619581    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 16:20:07.626549 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:07.626533    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 16:20:07.626617 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:07.626606    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs podName:fb2bcc30-f652-4940-86fb-dcc30bee1e11 nodeName:}" failed. No retries permitted until 2026-09-17 16:21:11.626584485 +0000 UTC m=+130.243480300 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs") pod "network-metrics-daemon-kn6qg" (UID: "fb2bcc30-f652-4940-86fb-dcc30bee1e11") : secret "metrics-daemon-secret" not found
Sep 17 16:20:07.629876 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.629855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c87a9f8-de64-442a-9e45-41b6448a2840-original-pull-secret\") pod \"global-pull-secret-syncer-k6kvk\" (UID: \"5c87a9f8-de64-442a-9e45-41b6448a2840\") " pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:20:07.716830 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.716797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:20:07.720057 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.720040    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 16:20:07.730174 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.730157    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 16:20:07.740189 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.740167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkv7\" (UniqueName: \"kubernetes.io/projected/ba28ffc6-2b98-4648-aba1-a0e843065769-kube-api-access-skkv7\") pod \"network-check-target-nxrgg\" (UID: \"ba28ffc6-2b98-4648-aba1-a0e843065769\") " pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:20:07.868721 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.868648    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6kvk"
Sep 17 16:20:07.876892 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.876870    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bxxrv\""
Sep 17 16:20:07.884207 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:07.884193    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:20:08.163661 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:08.163585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k6kvk"]
Sep 17 16:20:08.166439 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:08.166415    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c87a9f8_de64_442a_9e45_41b6448a2840.slice/crio-704df154f1547026b852e4243fffc7d38fa2c6b66e4f88b90b3a36957a7efda5 WatchSource:0}: Error finding container 704df154f1547026b852e4243fffc7d38fa2c6b66e4f88b90b3a36957a7efda5: Status 404 returned error can't find the container with id 704df154f1547026b852e4243fffc7d38fa2c6b66e4f88b90b3a36957a7efda5
Sep 17 16:20:08.195068 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:08.195045    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nxrgg"]
Sep 17 16:20:08.197761 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:08.197739    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba28ffc6_2b98_4648_aba1_a0e843065769.slice/crio-09839ce54fc3df0caa2d09da28798fd72be6dc53fa5ef9886d2f77e691a7cf21 WatchSource:0}: Error finding container 09839ce54fc3df0caa2d09da28798fd72be6dc53fa5ef9886d2f77e691a7cf21: Status 404 returned error can't find the container with id 09839ce54fc3df0caa2d09da28798fd72be6dc53fa5ef9886d2f77e691a7cf21
Sep 17 16:20:09.113979 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:09.113926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k6kvk" event={"ID":"5c87a9f8-de64-442a-9e45-41b6448a2840","Type":"ContainerStarted","Data":"704df154f1547026b852e4243fffc7d38fa2c6b66e4f88b90b3a36957a7efda5"}
Sep 17 16:20:09.115237 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:09.115198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nxrgg" event={"ID":"ba28ffc6-2b98-4648-aba1-a0e843065769","Type":"ContainerStarted","Data":"09839ce54fc3df0caa2d09da28798fd72be6dc53fa5ef9886d2f77e691a7cf21"}
Sep 17 16:20:12.047202 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:12.047167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:20:12.047638 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:12.047295    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 16:20:12.047638 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:12.047374    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls podName:f3357b42-4959-4ec0-afc5-f46447c539d7 nodeName:}" failed. No retries permitted until 2026-09-17 16:20:44.04735412 +0000 UTC m=+102.664249938 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls") pod "dns-default-7vpk7" (UID: "f3357b42-4959-4ec0-afc5-f46447c539d7") : secret "dns-default-metrics-tls" not found
Sep 17 16:20:14.130289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:14.130246    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nxrgg" event={"ID":"ba28ffc6-2b98-4648-aba1-a0e843065769","Type":"ContainerStarted","Data":"b03b972d73031b40299260efdd98d25006ea15887e8f44bda5eb8fb913e4b5c3"}
Sep 17 16:20:14.130778 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:14.130312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:20:14.131777 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:14.131757    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k6kvk" event={"ID":"5c87a9f8-de64-442a-9e45-41b6448a2840","Type":"ContainerStarted","Data":"5795ed4ada595c4daf9d3926c8b80a982fb3a0d167f77c750f475708ed82adce"}
Sep 17 16:20:14.149280 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:14.149233    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nxrgg" podStartSLOduration=67.037171168 podStartE2EDuration="1m12.149219464s" totalImagesPullingTime="5.112048296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:14.14808611 +0000 UTC m=+72.764981934" watchObservedRunningTime="2026-09-17 16:20:14.149219464 +0000 UTC m=+72.766115276"
Sep 17 16:20:14.166382 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:14.166337    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k6kvk" podStartSLOduration=67.018971526 podStartE2EDuration="1m12.166323446s" totalImagesPullingTime="5.14735192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:14.165618653 +0000 UTC m=+72.782514475" watchObservedRunningTime="2026-09-17 16:20:14.166323446 +0000 UTC m=+72.783219268"
Sep 17 16:20:27.515039 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.514898    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"]
Sep 17 16:20:27.517974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.517958    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57895869b7-8dmq8"]
Sep 17 16:20:27.518092 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.518075    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.520470 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.520449    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 16:20:27.520838 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.520823    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.520924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.520889    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 16:20:27.521324 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.521296    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 16:20:27.521324 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.521312    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2dw55\""
Sep 17 16:20:27.521324 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.521299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:20:27.522977 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.522961    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 16:20:27.523650 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.523625    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 16:20:27.523754 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.523659    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 16:20:27.523754 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.523694    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7wmpq\""
Sep 17 16:20:27.526545 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.526526    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"]
Sep 17 16:20:27.529764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.529736    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57895869b7-8dmq8"]
Sep 17 16:20:27.530373 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.530350    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 16:20:27.550220 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550198    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550308 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmsvk\" (UniqueName: \"kubernetes.io/projected/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-kube-api-access-lmsvk\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.550308 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.550308 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-certificates\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-installation-pull-secrets\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550356    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-bound-sa-token\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9d19b92-2f7d-4b31-9b0f-295640f902ea-ca-trust-extracted\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.550552 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-trusted-ca\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550552 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-image-registry-private-configuration\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.550552 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.550471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltkvv\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-kube-api-access-ltkvv\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.614725 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.614703    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-dj7lp"]
Sep 17 16:20:27.617526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.617511    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d54ddbbd6-gmj2s"]
Sep 17 16:20:27.617638 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.617624    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.620079 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.620060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.624500 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.624475    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 16:20:27.624500 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.624490    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:20:27.624665 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.624554    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sd5q8\""
Sep 17 16:20:27.624665 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.624481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 16:20:27.625327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 16:20:27.625567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625554    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 16:20:27.625651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625636    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 16:20:27.625719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625647    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 16:20:27.625812 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 16:20:27.625854 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625813    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 16:20:27.625893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.625877    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 16:20:27.626135 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.626121    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8xrqg\""
Sep 17 16:20:27.627241 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.627223    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 16:20:27.629570 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.629551    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-dj7lp"]
Sep 17 16:20:27.631285 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.631262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d54ddbbd6-gmj2s"]
Sep 17 16:20:27.640305 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.640287    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"]
Sep 17 16:20:27.643004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.642982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.645318 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.645300    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 16:20:27.645435 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.645324    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 16:20:27.645552 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.645538    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 16:20:27.645610 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.645560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 16:20:27.650761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.650743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-image-registry-private-configuration\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.650847 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.650767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltkvv\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-kube-api-access-ltkvv\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.650847 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.650798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-trusted-ca\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.650917 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.650841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.651001 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.650985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.651035 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf54d\" (UniqueName: \"kubernetes.io/projected/6b0e2b80-2805-4c9f-ab23-c742a273311e-kube-api-access-jf54d\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.651070 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmsvk\" (UniqueName: \"kubernetes.io/projected/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-kube-api-access-lmsvk\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.651143 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:27.651074    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 16:20:27.651143 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:27.651088    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57895869b7-8dmq8: secret "image-registry-tls" not found
Sep 17 16:20:27.651143 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:27.651138    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls podName:e9d19b92-2f7d-4b31-9b0f-295640f902ea nodeName:}" failed. No retries permitted until 2026-09-17 16:20:28.151125124 +0000 UTC m=+86.768020924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls") pod "image-registry-57895869b7-8dmq8" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea") : secret "image-registry-tls" not found
Sep 17 16:20:27.651289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.651289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-config\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.651289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.651289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-certificates\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.651289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-installation-pull-secrets\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-bound-sa-token\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-serving-cert\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-stats-auth\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9d19b92-2f7d-4b31-9b0f-295640f902ea-ca-trust-extracted\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-default-certificate\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-trusted-ca\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.651578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651510    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slt79\" (UniqueName: \"kubernetes.io/projected/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-kube-api-access-slt79\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.652108 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-certificates\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.652108 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.651967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9d19b92-2f7d-4b31-9b0f-295640f902ea-ca-trust-extracted\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.652249 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.652131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.652682 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.652664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-trusted-ca\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.653866 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.653844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-installation-pull-secrets\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.654001 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.653946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-image-registry-private-configuration\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.654123 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.654107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.654693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.654672    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"]
Sep 17 16:20:27.668429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.668405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmsvk\" (UniqueName: \"kubernetes.io/projected/df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321-kube-api-access-lmsvk\") pod \"kube-storage-version-migrator-operator-55889f7b47-zbkqh\" (UID: \"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.668983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.668960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-bound-sa-token\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.670346 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.670324    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltkvv\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-kube-api-access-ltkvv\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:27.707291 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.707269    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"]
Sep 17 16:20:27.711189 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.711174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.713759 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.713741    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 16:20:27.713852 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.713774    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 16:20:27.714008 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.713994    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 16:20:27.714098 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.714018    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 16:20:27.714165 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.714112    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ng27v\""
Sep 17 16:20:27.723947 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.723921    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"]
Sep 17 16:20:27.752448 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9psh7\" (UniqueName: \"kubernetes.io/projected/2b52fe24-9fb5-486f-b586-470ecbb245cf-kube-api-access-9psh7\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.752572 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1b07bb-2199-4972-a539-54b066669acb-serving-cert\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.752572 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-trusted-ca\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.752572 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fd9l\" (UniqueName: \"kubernetes.io/projected/fa1b07bb-2199-4972-a539-54b066669acb-kube-api-access-2fd9l\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.752755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-config\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.752755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1b07bb-2199-4972-a539-54b066669acb-config\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.752755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-stats-auth\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.752755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2b52fe24-9fb5-486f-b586-470ecbb245cf-klusterlet-config\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.752755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-default-certificate\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.752755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slt79\" (UniqueName: \"kubernetes.io/projected/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-kube-api-access-slt79\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.753039 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.753039 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b52fe24-9fb5-486f-b586-470ecbb245cf-tmp\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.753039 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:27.752983    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:28.252962201 +0000 UTC m=+86.869858016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : configmap references non-existent config key: service-ca.crt
Sep 17 16:20:27.754095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.754070    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-config\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.754350 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.754323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-trusted-ca\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.755719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.755700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-default-certificate\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.757802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.752865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf54d\" (UniqueName: \"kubernetes.io/projected/6b0e2b80-2805-4c9f-ab23-c742a273311e-kube-api-access-jf54d\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.757802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.755991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-stats-auth\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.757802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.756021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.757802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.756079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-serving-cert\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.757802 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:27.757731    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 16:20:27.758084 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:27.757830    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:28.257784199 +0000 UTC m=+86.874680000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : secret "router-metrics-certs-default" not found
Sep 17 16:20:27.758872 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.758851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-serving-cert\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.762180 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.762159    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf54d\" (UniqueName: \"kubernetes.io/projected/6b0e2b80-2805-4c9f-ab23-c742a273311e-kube-api-access-jf54d\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:27.762278 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.762262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slt79\" (UniqueName: \"kubernetes.io/projected/3c978f3f-b1dc-45f7-a03f-a20d665d6fe4-kube-api-access-slt79\") pod \"console-operator-fd4bb46c-dj7lp\" (UID: \"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4\") " pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.829056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.829029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"
Sep 17 16:20:27.856638 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b52fe24-9fb5-486f-b586-470ecbb245cf-tmp\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.856772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9psh7\" (UniqueName: \"kubernetes.io/projected/2b52fe24-9fb5-486f-b586-470ecbb245cf-kube-api-access-9psh7\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.856772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1b07bb-2199-4972-a539-54b066669acb-serving-cert\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.856772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fd9l\" (UniqueName: \"kubernetes.io/projected/fa1b07bb-2199-4972-a539-54b066669acb-kube-api-access-2fd9l\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.856947 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1b07bb-2199-4972-a539-54b066669acb-config\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.857004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856968    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b52fe24-9fb5-486f-b586-470ecbb245cf-tmp\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.857004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.856978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2b52fe24-9fb5-486f-b586-470ecbb245cf-klusterlet-config\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.857498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.857470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa1b07bb-2199-4972-a539-54b066669acb-config\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.858964 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.858938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa1b07bb-2199-4972-a539-54b066669acb-serving-cert\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.859321 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.859303    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2b52fe24-9fb5-486f-b586-470ecbb245cf-klusterlet-config\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.867465 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.867439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fd9l\" (UniqueName: \"kubernetes.io/projected/fa1b07bb-2199-4972-a539-54b066669acb-kube-api-access-2fd9l\") pod \"service-ca-operator-57cdc4b768-p7mtw\" (UID: \"fa1b07bb-2199-4972-a539-54b066669acb\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:27.867556 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.867540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9psh7\" (UniqueName: \"kubernetes.io/projected/2b52fe24-9fb5-486f-b586-470ecbb245cf-kube-api-access-9psh7\") pod \"klusterlet-addon-workmgr-d67f6cb7f-5wv5n\" (UID: \"2b52fe24-9fb5-486f-b586-470ecbb245cf\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:27.927831 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.927801    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:27.951035 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:27.951012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:28.019899 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.019876    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"
Sep 17 16:20:28.097476 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.097404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh"]
Sep 17 16:20:28.100147 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:28.100117    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6ebbdf_7e4f_4b98_97a1_1c80a9dd8321.slice/crio-0b5965fb8f697a3db83a90ce97ec93c19275589f01f28ee423f948760242e77d WatchSource:0}: Error finding container 0b5965fb8f697a3db83a90ce97ec93c19275589f01f28ee423f948760242e77d: Status 404 returned error can't find the container with id 0b5965fb8f697a3db83a90ce97ec93c19275589f01f28ee423f948760242e77d
Sep 17 16:20:28.160548 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.160525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:28.160641 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:28.160629    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 16:20:28.160641 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:28.160640    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57895869b7-8dmq8: secret "image-registry-tls" not found
Sep 17 16:20:28.160708 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:28.160685    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls podName:e9d19b92-2f7d-4b31-9b0f-295640f902ea nodeName:}" failed. No retries permitted until 2026-09-17 16:20:29.160672291 +0000 UTC m=+87.777568092 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls") pod "image-registry-57895869b7-8dmq8" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea") : secret "image-registry-tls" not found
Sep 17 16:20:28.165191 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.165165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh" event={"ID":"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321","Type":"ContainerStarted","Data":"0b5965fb8f697a3db83a90ce97ec93c19275589f01f28ee423f948760242e77d"}
Sep 17 16:20:28.199660 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.199635    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-dj7lp"]
Sep 17 16:20:28.202250 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:28.202216    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c978f3f_b1dc_45f7_a03f_a20d665d6fe4.slice/crio-9636d2fa51083267361d7d2d5ca044c5c590af105d3a2360d419fe0d1d1f0c41 WatchSource:0}: Error finding container 9636d2fa51083267361d7d2d5ca044c5c590af105d3a2360d419fe0d1d1f0c41: Status 404 returned error can't find the container with id 9636d2fa51083267361d7d2d5ca044c5c590af105d3a2360d419fe0d1d1f0c41
Sep 17 16:20:28.223230 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.223207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"]
Sep 17 16:20:28.225864 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:28.225837    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b52fe24_9fb5_486f_b586_470ecbb245cf.slice/crio-623a9c4a11a19125b8c9c606a52766bf2f6d6750fcc04f27075c318eb1558d84 WatchSource:0}: Error finding container 623a9c4a11a19125b8c9c606a52766bf2f6d6750fcc04f27075c318eb1558d84: Status 404 returned error can't find the container with id 623a9c4a11a19125b8c9c606a52766bf2f6d6750fcc04f27075c318eb1558d84
Sep 17 16:20:28.261842 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.261818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:28.261908 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.261885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:28.261976 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:28.261960    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 16:20:28.262008 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:28.262003    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:29.261989565 +0000 UTC m=+87.878885379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : configmap references non-existent config key: service-ca.crt
Sep 17 16:20:28.262043 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:28.262018    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:29.262011468 +0000 UTC m=+87.878907268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : secret "router-metrics-certs-default" not found
Sep 17 16:20:28.285485 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:28.285464    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw"]
Sep 17 16:20:28.288962 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:28.288943    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1b07bb_2199_4972_a539_54b066669acb.slice/crio-4e255af4c045989cc9091f1c6eba4b0ebdc450a0afa2baa04203859559fa1db1 WatchSource:0}: Error finding container 4e255af4c045989cc9091f1c6eba4b0ebdc450a0afa2baa04203859559fa1db1: Status 404 returned error can't find the container with id 4e255af4c045989cc9091f1c6eba4b0ebdc450a0afa2baa04203859559fa1db1
Sep 17 16:20:29.170430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:29.169872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:29.170430 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:29.170010    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 16:20:29.170430 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:29.170025    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57895869b7-8dmq8: secret "image-registry-tls" not found
Sep 17 16:20:29.170430 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:29.170079    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls podName:e9d19b92-2f7d-4b31-9b0f-295640f902ea nodeName:}" failed. No retries permitted until 2026-09-17 16:20:31.170061378 +0000 UTC m=+89.786957183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls") pod "image-registry-57895869b7-8dmq8" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea") : secret "image-registry-tls" not found
Sep 17 16:20:29.172053 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:29.172022    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n" event={"ID":"2b52fe24-9fb5-486f-b586-470ecbb245cf","Type":"ContainerStarted","Data":"623a9c4a11a19125b8c9c606a52766bf2f6d6750fcc04f27075c318eb1558d84"}
Sep 17 16:20:29.173636 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:29.173570    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw" event={"ID":"fa1b07bb-2199-4972-a539-54b066669acb","Type":"ContainerStarted","Data":"4e255af4c045989cc9091f1c6eba4b0ebdc450a0afa2baa04203859559fa1db1"}
Sep 17 16:20:29.175111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:29.175086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" event={"ID":"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4","Type":"ContainerStarted","Data":"9636d2fa51083267361d7d2d5ca044c5c590af105d3a2360d419fe0d1d1f0c41"}
Sep 17 16:20:29.270915 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:29.270879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:29.271076 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:29.270943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:29.271076 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:29.271065    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 16:20:29.271181 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:29.271071    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:31.27105075 +0000 UTC m=+89.887946564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : configmap references non-existent config key: service-ca.crt
Sep 17 16:20:29.271181 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:29.271106    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:31.271095079 +0000 UTC m=+89.887990879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : secret "router-metrics-certs-default" not found
Sep 17 16:20:31.190410 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:31.190363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:31.190824 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:31.190582    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 16:20:31.190824 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:31.190610    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57895869b7-8dmq8: secret "image-registry-tls" not found
Sep 17 16:20:31.190824 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:31.190664    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls podName:e9d19b92-2f7d-4b31-9b0f-295640f902ea nodeName:}" failed. No retries permitted until 2026-09-17 16:20:35.190645925 +0000 UTC m=+93.807541731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls") pod "image-registry-57895869b7-8dmq8" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea") : secret "image-registry-tls" not found
Sep 17 16:20:31.291729 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:31.291687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:31.291901 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:31.291826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:31.291988 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:31.291974    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:35.291956273 +0000 UTC m=+93.908852088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : configmap references non-existent config key: service-ca.crt
Sep 17 16:20:31.292412 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:31.292376    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 16:20:31.292507 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:31.292450    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:35.292435337 +0000 UTC m=+93.909331174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : secret "router-metrics-certs-default" not found
Sep 17 16:20:32.187613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.187571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" event={"ID":"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4","Type":"ContainerStarted","Data":"c408c30b8c18961e3e39eb7a2d72b694943060dc8d4e992fe3e0711f5a89d482"}
Sep 17 16:20:32.188132 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.188073    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:32.190423 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.189351    2582 patch_prober.go:28] interesting pod/console-operator-fd4bb46c-dj7lp container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.10:8443/readyz\": dial tcp 10.133.0.10:8443: connect: connection refused" start-of-body=
Sep 17 16:20:32.190423 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.189423    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" podUID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.10:8443/readyz\": dial tcp 10.133.0.10:8443: connect: connection refused"
Sep 17 16:20:32.191488 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.191461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh" event={"ID":"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321","Type":"ContainerStarted","Data":"7d5c73059ada94e9438515c23d7735bdfd009234c59aa1aacf61dbdb9e092050"}
Sep 17 16:20:32.194350 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.194003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw" event={"ID":"fa1b07bb-2199-4972-a539-54b066669acb","Type":"ContainerStarted","Data":"555374b78127469c3c8f48c2b8348bfda07b4a4cdb4027f8ab1a9edce5a99174"}
Sep 17 16:20:32.208090 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.208037    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" podStartSLOduration=2.023813258 podStartE2EDuration="5.208020926s" totalImagesPullingTime="3.184207668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:32.207026266 +0000 UTC m=+90.823922110" watchObservedRunningTime="2026-09-17 16:20:32.208020926 +0000 UTC m=+90.824916750"
Sep 17 16:20:32.226422 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.225588    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw" podStartSLOduration=2.121112871 podStartE2EDuration="5.225569669s" totalImagesPullingTime="3.104456798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:32.224785367 +0000 UTC m=+90.841681189" watchObservedRunningTime="2026-09-17 16:20:32.225569669 +0000 UTC m=+90.842465492"
Sep 17 16:20:32.247218 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.246711    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh" podStartSLOduration=1.964432854 podStartE2EDuration="5.246695871s" totalImagesPullingTime="3.282263017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:32.245211447 +0000 UTC m=+90.862107270" watchObservedRunningTime="2026-09-17 16:20:32.246695871 +0000 UTC m=+90.863591697"
Sep 17 16:20:32.884635 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.884572    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g2w9t"]
Sep 17 16:20:32.888154 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.888128    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:32.890524 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.890498    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 16:20:32.890646 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.890582    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 16:20:32.890847 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.890807    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 16:20:32.891709 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.891586    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 16:20:32.891709 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.891625    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dkcr6\""
Sep 17 16:20:32.901662 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:32.900316    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g2w9t"]
Sep 17 16:20:33.008796 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.008753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.008992 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.008806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.008992 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.008909    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-data-volume\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.008992 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.008956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4x8\" (UniqueName: \"kubernetes.io/projected/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-api-access-vp4x8\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.009138 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.009065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-crio-socket\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.110355 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.110563 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.110563 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-data-volume\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.110563 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4x8\" (UniqueName: \"kubernetes.io/projected/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-api-access-vp4x8\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.110563 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.110501    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:33.110563 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.110536    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 16:20:33.110811 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.110575    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:33.610553187 +0000 UTC m=+92.227448997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:33.110811 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.110603    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:33.610585544 +0000 UTC m=+92.227481361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : configmap "kube-rbac-proxy" not found
Sep 17 16:20:33.110811 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-crio-socket\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.110811 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110752    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-crio-socket\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.111017 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.110872    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-data-volume\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.121336 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.121310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4x8\" (UniqueName: \"kubernetes.io/projected/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-api-access-vp4x8\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.201434 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.200221    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/0.log"
Sep 17 16:20:33.201434 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.200267    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4" containerID="c408c30b8c18961e3e39eb7a2d72b694943060dc8d4e992fe3e0711f5a89d482" exitCode=255
Sep 17 16:20:33.201434 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.200603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" event={"ID":"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4","Type":"ContainerDied","Data":"c408c30b8c18961e3e39eb7a2d72b694943060dc8d4e992fe3e0711f5a89d482"}
Sep 17 16:20:33.201434 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.200930    2582 scope.go:117] "RemoveContainer" containerID="c408c30b8c18961e3e39eb7a2d72b694943060dc8d4e992fe3e0711f5a89d482"
Sep 17 16:20:33.615136 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.615105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.615263 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.615141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:33.615263 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.615225    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 16:20:33.615263 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.615248    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:33.615358 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.615288    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:34.615270019 +0000 UTC m=+93.232165837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : configmap "kube-rbac-proxy" not found
Sep 17 16:20:33.615358 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:33.615303    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:34.615296633 +0000 UTC m=+93.232192433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:33.824994 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.824925    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"]
Sep 17 16:20:33.827883 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.827867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"
Sep 17 16:20:33.830747 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.830716    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 16:20:33.830747 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.830738    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 16:20:33.831496 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.831470    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-q689n\""
Sep 17 16:20:33.839881 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.839860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"]
Sep 17 16:20:33.918136 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:33.918103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f29jw\" (UniqueName: \"kubernetes.io/projected/b74961b7-1e9e-4509-8356-e88368402b70-kube-api-access-f29jw\") pod \"migrator-76794cbd6c-rhf9z\" (UID: \"b74961b7-1e9e-4509-8356-e88368402b70\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"
Sep 17 16:20:34.019159 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.019128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29jw\" (UniqueName: \"kubernetes.io/projected/b74961b7-1e9e-4509-8356-e88368402b70-kube-api-access-f29jw\") pod \"migrator-76794cbd6c-rhf9z\" (UID: \"b74961b7-1e9e-4509-8356-e88368402b70\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"
Sep 17 16:20:34.028280 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.028249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f29jw\" (UniqueName: \"kubernetes.io/projected/b74961b7-1e9e-4509-8356-e88368402b70-kube-api-access-f29jw\") pod \"migrator-76794cbd6c-rhf9z\" (UID: \"b74961b7-1e9e-4509-8356-e88368402b70\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"
Sep 17 16:20:34.140611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.140525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"
Sep 17 16:20:34.205205 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.205172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n" event={"ID":"2b52fe24-9fb5-486f-b586-470ecbb245cf","Type":"ContainerStarted","Data":"295bf321269e2bcbecec1a85c94c028a04719957aa4c79c5b53d9756faa75543"}
Sep 17 16:20:34.205628 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.205232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:34.207202 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.207080    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:20:34.207202 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.207128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n"
Sep 17 16:20:34.208210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.207520    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/0.log"
Sep 17 16:20:34.208210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.207555    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4" containerID="950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1" exitCode=255
Sep 17 16:20:34.208210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.207600    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" event={"ID":"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4","Type":"ContainerDied","Data":"950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1"}
Sep 17 16:20:34.208210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.207642    2582 scope.go:117] "RemoveContainer" containerID="c408c30b8c18961e3e39eb7a2d72b694943060dc8d4e992fe3e0711f5a89d482"
Sep 17 16:20:34.208210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.208030    2582 scope.go:117] "RemoveContainer" containerID="950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1"
Sep 17 16:20:34.208210 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:34.208201    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-dj7lp_openshift-console-operator(3c978f3f-b1dc-45f7-a03f-a20d665d6fe4)\"" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" podUID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4"
Sep 17 16:20:34.222804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.222765    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d67f6cb7f-5wv5n" podStartSLOduration=1.8135664280000001 podStartE2EDuration="7.22275176s" totalImagesPullingTime="5.409185332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:34.222172132 +0000 UTC m=+92.839067953" watchObservedRunningTime="2026-09-17 16:20:34.22275176 +0000 UTC m=+92.839647581"
Sep 17 16:20:34.413161 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.413138    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z"]
Sep 17 16:20:34.415533 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:34.415508    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74961b7_1e9e_4509_8356_e88368402b70.slice/crio-240f231d3b2b92b61da006864f0ffea5270ea12bce8a301dd97abd9ea97647ad WatchSource:0}: Error finding container 240f231d3b2b92b61da006864f0ffea5270ea12bce8a301dd97abd9ea97647ad: Status 404 returned error can't find the container with id 240f231d3b2b92b61da006864f0ffea5270ea12bce8a301dd97abd9ea97647ad
Sep 17 16:20:34.624456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.624422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:34.624456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.624459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:34.624661 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:34.624576    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:34.624661 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:34.624611    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 16:20:34.624661 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:34.624639    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:36.624622798 +0000 UTC m=+95.241518598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:34.624661 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:34.624661    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:36.624649141 +0000 UTC m=+95.241544945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : configmap "kube-rbac-proxy" not found
Sep 17 16:20:34.643820 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.643795    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftr9x_9bbe7c5d-6104-42d8-beee-163d4d2a8953/dns-node-resolver/0.log"
Sep 17 16:20:34.816135 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.816099    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-42msj"]
Sep 17 16:20:34.820291 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.820271    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:34.822750 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.822725    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 16:20:34.822874 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.822773    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 16:20:34.822874 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.822800    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wmjsj\""
Sep 17 16:20:34.822874 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.822865    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 16:20:34.823005 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.822890    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 16:20:34.828749 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.828712    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-42msj"]
Sep 17 16:20:34.926668 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.926623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c6706a9-e316-4318-af59-5fa8b51617cc-signing-cabundle\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:34.926861 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.926772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c6706a9-e316-4318-af59-5fa8b51617cc-signing-key\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:34.926861 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:34.926811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nckbj\" (UniqueName: \"kubernetes.io/projected/7c6706a9-e316-4318-af59-5fa8b51617cc-kube-api-access-nckbj\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.028159 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.028122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c6706a9-e316-4318-af59-5fa8b51617cc-signing-key\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.028320 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.028174    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nckbj\" (UniqueName: \"kubernetes.io/projected/7c6706a9-e316-4318-af59-5fa8b51617cc-kube-api-access-nckbj\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.028320 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.028239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c6706a9-e316-4318-af59-5fa8b51617cc-signing-cabundle\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.028914 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.028808    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7c6706a9-e316-4318-af59-5fa8b51617cc-signing-cabundle\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.030642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.030623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7c6706a9-e316-4318-af59-5fa8b51617cc-signing-key\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.038196 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.038174    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nckbj\" (UniqueName: \"kubernetes.io/projected/7c6706a9-e316-4318-af59-5fa8b51617cc-kube-api-access-nckbj\") pod \"service-ca-55f6fc7b86-42msj\" (UID: \"7c6706a9-e316-4318-af59-5fa8b51617cc\") " pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.129354 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.129257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-42msj"
Sep 17 16:20:35.212871 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.212846    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:20:35.213268 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.213244    2582 scope.go:117] "RemoveContainer" containerID="950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1"
Sep 17 16:20:35.213512 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.213471    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-dj7lp_openshift-console-operator(3c978f3f-b1dc-45f7-a03f-a20d665d6fe4)\"" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" podUID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4"
Sep 17 16:20:35.214430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.214404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z" event={"ID":"b74961b7-1e9e-4509-8356-e88368402b70","Type":"ContainerStarted","Data":"240f231d3b2b92b61da006864f0ffea5270ea12bce8a301dd97abd9ea97647ad"}
Sep 17 16:20:35.230328 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.230299    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:35.230489 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.230473    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 16:20:35.230536 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.230493    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57895869b7-8dmq8: secret "image-registry-tls" not found
Sep 17 16:20:35.230584 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.230550    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls podName:e9d19b92-2f7d-4b31-9b0f-295640f902ea nodeName:}" failed. No retries permitted until 2026-09-17 16:20:43.230533644 +0000 UTC m=+101.847429465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls") pod "image-registry-57895869b7-8dmq8" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea") : secret "image-registry-tls" not found
Sep 17 16:20:35.331085 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.331052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:35.331218 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.331117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:35.331287 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.331257    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 16:20:35.331336 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.331319    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:43.331294694 +0000 UTC m=+101.948190517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : configmap references non-existent config key: service-ca.crt
Sep 17 16:20:35.331419 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:35.331345    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs podName:6b0e2b80-2805-4c9f-ab23-c742a273311e nodeName:}" failed. No retries permitted until 2026-09-17 16:20:43.331334999 +0000 UTC m=+101.948230801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs") pod "router-default-5d54ddbbd6-gmj2s" (UID: "6b0e2b80-2805-4c9f-ab23-c742a273311e") : secret "router-metrics-certs-default" not found
Sep 17 16:20:35.407598 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.407197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-42msj"]
Sep 17 16:20:35.622296 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:35.622263    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6706a9_e316_4318_af59_5fa8b51617cc.slice/crio-5594d2e5cd66fb77ac320281110f9ea8652006df147290d598b1e32efa304770 WatchSource:0}: Error finding container 5594d2e5cd66fb77ac320281110f9ea8652006df147290d598b1e32efa304770: Status 404 returned error can't find the container with id 5594d2e5cd66fb77ac320281110f9ea8652006df147290d598b1e32efa304770
Sep 17 16:20:35.646775 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:35.646756    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c7bhg_b9f055da-addd-48a6-b837-9becc8d45ed2/node-ca/0.log"
Sep 17 16:20:36.219120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.219083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-42msj" event={"ID":"7c6706a9-e316-4318-af59-5fa8b51617cc","Type":"ContainerStarted","Data":"45aeef961d915be5c7b07aa4374158cccec711a2a3678a65f8c02bcfa213b0f8"}
Sep 17 16:20:36.219519 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.219147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-42msj" event={"ID":"7c6706a9-e316-4318-af59-5fa8b51617cc","Type":"ContainerStarted","Data":"5594d2e5cd66fb77ac320281110f9ea8652006df147290d598b1e32efa304770"}
Sep 17 16:20:36.221135 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.221107    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z" event={"ID":"b74961b7-1e9e-4509-8356-e88368402b70","Type":"ContainerStarted","Data":"972cdf62e5c0b3204d94f582ef3f40912a5ec3c224d411712dbf8f715c1c10aa"}
Sep 17 16:20:36.221250 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.221154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z" event={"ID":"b74961b7-1e9e-4509-8356-e88368402b70","Type":"ContainerStarted","Data":"4f3f82c614640552400c98a28f090f3d0f08de187ec93986c28085a2d3a9d96b"}
Sep 17 16:20:36.237631 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.237591    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-42msj" podStartSLOduration=2.237577859 podStartE2EDuration="2.237577859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:36.237184551 +0000 UTC m=+94.854080372" watchObservedRunningTime="2026-09-17 16:20:36.237577859 +0000 UTC m=+94.854473681"
Sep 17 16:20:36.254824 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.254780    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-rhf9z" podStartSLOduration=2.00122361 podStartE2EDuration="3.25476498s" totalImagesPullingTime="1.25354137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:36.254506472 +0000 UTC m=+94.871402294" watchObservedRunningTime="2026-09-17 16:20:36.25476498 +0000 UTC m=+94.871660803"
Sep 17 16:20:36.641382 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.641343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:36.641382 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.641382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:36.641590 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:36.641466    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 16:20:36.641590 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:36.641513    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:40.641499326 +0000 UTC m=+99.258395139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : configmap "kube-rbac-proxy" not found
Sep 17 16:20:36.641590 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:36.641508    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:36.641590 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:36.641573    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:40.641555842 +0000 UTC m=+99.258451642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:36.643169 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:36.643146    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fg78m_069ac91f-a50e-4868-bf37-739b1973f072/serve-healthcheck-canary/0.log"
Sep 17 16:20:37.928868 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:37.928825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:37.929238 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:37.929200    2582 scope.go:117] "RemoveContainer" containerID="950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1"
Sep 17 16:20:37.929369 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:37.929349    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-dj7lp_openshift-console-operator(3c978f3f-b1dc-45f7-a03f-a20d665d6fe4)\"" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" podUID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4"
Sep 17 16:20:40.676575 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:40.676537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:40.676575 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:40.676575    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:40.677042 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:40.676681    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:40.677042 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:40.676697    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 16:20:40.677042 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:40.676758    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:48.676745251 +0000 UTC m=+107.293641065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : configmap "kube-rbac-proxy" not found
Sep 17 16:20:40.677042 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:40.676773    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls podName:023a78eb-eb67-46c7-9cbb-ea60ff4b397f nodeName:}" failed. No retries permitted until 2026-09-17 16:20:48.676765653 +0000 UTC m=+107.293661453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g2w9t" (UID: "023a78eb-eb67-46c7-9cbb-ea60ff4b397f") : secret "insights-runtime-extractor-tls" not found
Sep 17 16:20:42.188849 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:42.188814    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:42.189292 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:42.189162    2582 scope.go:117] "RemoveContainer" containerID="950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1"
Sep 17 16:20:42.189337 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:20:42.189298    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-dj7lp_openshift-console-operator(3c978f3f-b1dc-45f7-a03f-a20d665d6fe4)\"" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" podUID="3c978f3f-b1dc-45f7-a03f-a20d665d6fe4"
Sep 17 16:20:43.297404 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.297365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:43.299809 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.299780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"image-registry-57895869b7-8dmq8\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") " pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:43.397989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.397941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:43.398162 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.398021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:43.398644 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.398615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0e2b80-2805-4c9f-ab23-c742a273311e-service-ca-bundle\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:43.400436 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.400417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b0e2b80-2805-4c9f-ab23-c742a273311e-metrics-certs\") pod \"router-default-5d54ddbbd6-gmj2s\" (UID: \"6b0e2b80-2805-4c9f-ab23-c742a273311e\") " pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:43.436486 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.436459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:43.534166 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.534135    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:43.717287 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.717251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57895869b7-8dmq8"]
Sep 17 16:20:43.722067 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:43.722038    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d19b92_2f7d_4b31_9b0f_295640f902ea.slice/crio-b03877d3f3fcd5a1442194e31f2a93a4c9254f0beb0c241361d14992ff840f7d WatchSource:0}: Error finding container b03877d3f3fcd5a1442194e31f2a93a4c9254f0beb0c241361d14992ff840f7d: Status 404 returned error can't find the container with id b03877d3f3fcd5a1442194e31f2a93a4c9254f0beb0c241361d14992ff840f7d
Sep 17 16:20:43.820299 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:43.820266    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d54ddbbd6-gmj2s"]
Sep 17 16:20:43.822933 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:43.822903    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0e2b80_2805_4c9f_ab23_c742a273311e.slice/crio-c91e57adce46235394c874a76b561e1e2295d76b80b7e054b3a854aed0cc1286 WatchSource:0}: Error finding container c91e57adce46235394c874a76b561e1e2295d76b80b7e054b3a854aed0cc1286: Status 404 returned error can't find the container with id c91e57adce46235394c874a76b561e1e2295d76b80b7e054b3a854aed0cc1286
Sep 17 16:20:44.104501 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.104410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:20:44.106740 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.106710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3357b42-4959-4ec0-afc5-f46447c539d7-metrics-tls\") pod \"dns-default-7vpk7\" (UID: \"f3357b42-4959-4ec0-afc5-f46447c539d7\") " pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:20:44.112568 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.112549    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hkm7f\""
Sep 17 16:20:44.120249 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.120233    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:20:44.250095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.250055    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s" event={"ID":"6b0e2b80-2805-4c9f-ab23-c742a273311e","Type":"ContainerStarted","Data":"f32c6291d9d5533f307ea82c37b69e483efef6a976ff00265591953498bc0361"}
Sep 17 16:20:44.250266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.250116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s" event={"ID":"6b0e2b80-2805-4c9f-ab23-c742a273311e","Type":"ContainerStarted","Data":"c91e57adce46235394c874a76b561e1e2295d76b80b7e054b3a854aed0cc1286"}
Sep 17 16:20:44.251744 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.251712    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" event={"ID":"e9d19b92-2f7d-4b31-9b0f-295640f902ea","Type":"ContainerStarted","Data":"c7791db90ad9df1ad96e176c88c9b547c9054e42798ff70e6eea28d63089b607"}
Sep 17 16:20:44.251849 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.251773    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" event={"ID":"e9d19b92-2f7d-4b31-9b0f-295640f902ea","Type":"ContainerStarted","Data":"b03877d3f3fcd5a1442194e31f2a93a4c9254f0beb0c241361d14992ff840f7d"}
Sep 17 16:20:44.251849 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.251795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:20:44.270981 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.270933    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s" podStartSLOduration=17.270916318 podStartE2EDuration="17.270916318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:44.270820376 +0000 UTC m=+102.887716199" watchObservedRunningTime="2026-09-17 16:20:44.270916318 +0000 UTC m=+102.887812141"
Sep 17 16:20:44.292911 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.292863    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" podStartSLOduration=17.29285139 podStartE2EDuration="17.29285139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:44.291939265 +0000 UTC m=+102.908835081" watchObservedRunningTime="2026-09-17 16:20:44.29285139 +0000 UTC m=+102.909747209"
Sep 17 16:20:44.394037 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.394011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7vpk7"]
Sep 17 16:20:44.395681 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:44.395651    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3357b42_4959_4ec0_afc5_f46447c539d7.slice/crio-ee2d5c3ad4e2924dab7c9d44cbc2ac5b852870c881acd03a198cc6cfded06b68 WatchSource:0}: Error finding container ee2d5c3ad4e2924dab7c9d44cbc2ac5b852870c881acd03a198cc6cfded06b68: Status 404 returned error can't find the container with id ee2d5c3ad4e2924dab7c9d44cbc2ac5b852870c881acd03a198cc6cfded06b68
Sep 17 16:20:44.535271 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.535232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:44.537836 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:44.537812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:45.137640 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:45.137544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nxrgg"
Sep 17 16:20:45.255900 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:45.255871    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vpk7" event={"ID":"f3357b42-4959-4ec0-afc5-f46447c539d7","Type":"ContainerStarted","Data":"ee2d5c3ad4e2924dab7c9d44cbc2ac5b852870c881acd03a198cc6cfded06b68"}
Sep 17 16:20:45.256235 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:45.256212    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:45.257376 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:45.257353    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d54ddbbd6-gmj2s"
Sep 17 16:20:47.265643 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:47.265553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vpk7" event={"ID":"f3357b42-4959-4ec0-afc5-f46447c539d7","Type":"ContainerStarted","Data":"6d1ca2d6925ac9b4e66225ee382777bd0c1dc75a7bcd674e785d860be57c25e4"}
Sep 17 16:20:47.265643 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:47.265622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7vpk7" event={"ID":"f3357b42-4959-4ec0-afc5-f46447c539d7","Type":"ContainerStarted","Data":"f4bfc4d50646779f734fc2af901198a7a29f2e081605b9821a27f5bcf80ea59a"}
Sep 17 16:20:47.266039 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:47.265755    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:20:47.288310 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:47.288261    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7vpk7" podStartSLOduration=64.982558547 podStartE2EDuration="1m7.288245263s" totalImagesPullingTime="2.305686716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:47.287655874 +0000 UTC m=+105.904551697" watchObservedRunningTime="2026-09-17 16:20:47.288245263 +0000 UTC m=+105.905141084"
Sep 17 16:20:48.742778 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:48.742748    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:48.743282 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:48.742849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:48.743449 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:48.743426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:48.745261 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:48.745241    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/023a78eb-eb67-46c7-9cbb-ea60ff4b397f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g2w9t\" (UID: \"023a78eb-eb67-46c7-9cbb-ea60ff4b397f\") " pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:48.800441 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:48.800408    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g2w9t"
Sep 17 16:20:49.101456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:49.101414    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g2w9t"]
Sep 17 16:20:49.106740 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:20:49.106703    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023a78eb_eb67_46c7_9cbb_ea60ff4b397f.slice/crio-213db415440c6c3dad725bbdf66dd169e13ddbea49920f2784ae74376913eac7 WatchSource:0}: Error finding container 213db415440c6c3dad725bbdf66dd169e13ddbea49920f2784ae74376913eac7: Status 404 returned error can't find the container with id 213db415440c6c3dad725bbdf66dd169e13ddbea49920f2784ae74376913eac7
Sep 17 16:20:49.274199 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:49.274165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2w9t" event={"ID":"023a78eb-eb67-46c7-9cbb-ea60ff4b397f","Type":"ContainerStarted","Data":"e19597b8db8a72f3fc9ebb992a3ecc4c06adebcb0b099269a546bc8e0c3fba0e"}
Sep 17 16:20:49.274340 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:49.274219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2w9t" event={"ID":"023a78eb-eb67-46c7-9cbb-ea60ff4b397f","Type":"ContainerStarted","Data":"213db415440c6c3dad725bbdf66dd169e13ddbea49920f2784ae74376913eac7"}
Sep 17 16:20:51.283292 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:51.283252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2w9t" event={"ID":"023a78eb-eb67-46c7-9cbb-ea60ff4b397f","Type":"ContainerStarted","Data":"b75b6be1b9d377790dc9ba8c8911969e39cbfa6501e5f41b78654ff5c7b75084"}
Sep 17 16:20:53.293567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:53.293528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g2w9t" event={"ID":"023a78eb-eb67-46c7-9cbb-ea60ff4b397f","Type":"ContainerStarted","Data":"51d0f06d23ed799b1d5165a454cca09d2351a1a0b40e19ff0ae4ac24b280e97c"}
Sep 17 16:20:53.319813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:53.319764    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g2w9t" podStartSLOduration=18.483806413 podStartE2EDuration="21.319750041s" totalImagesPullingTime="2.835943628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:20:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:20:53.317897098 +0000 UTC m=+111.934792920" watchObservedRunningTime="2026-09-17 16:20:53.319750041 +0000 UTC m=+111.936645860"
Sep 17 16:20:53.856327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:53.856300    2582 scope.go:117] "RemoveContainer" containerID="950843974abb86e6190eb11e14e4b2f1e26534eb90c4e1edd1b264c4f64cc9d1"
Sep 17 16:20:54.299153 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:54.299128    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:20:54.299525 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:54.299242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp" event={"ID":"3c978f3f-b1dc-45f7-a03f-a20d665d6fe4","Type":"ContainerStarted","Data":"8d7cd1821bc01661e42e67cb3a0aaff2c0f101183bbf391a4b791631b1462452"}
Sep 17 16:20:54.299693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:54.299672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:54.373279 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:54.373247    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-dj7lp"
Sep 17 16:20:57.271688 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:20:57.271654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7vpk7"
Sep 17 16:21:00.263686 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:00.263660    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57895869b7-8dmq8"]
Sep 17 16:21:00.268344 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:00.268317    2582 patch_prober.go:28] interesting pod/image-registry-57895869b7-8dmq8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 16:21:00.268489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:00.268371    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" podUID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 16:21:10.268505 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:10.268477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:21:11.718308 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:11.718273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:21:11.720718 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:11.720692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb2bcc30-f652-4940-86fb-dcc30bee1e11-metrics-certs\") pod \"network-metrics-daemon-kn6qg\" (UID: \"fb2bcc30-f652-4940-86fb-dcc30bee1e11\") " pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:21:11.766599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:11.766577    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bq92d\""
Sep 17 16:21:11.774205 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:11.774186    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kn6qg"
Sep 17 16:21:12.049946 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:12.049918    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kn6qg"]
Sep 17 16:21:12.361005 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:12.360915    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kn6qg" event={"ID":"fb2bcc30-f652-4940-86fb-dcc30bee1e11","Type":"ContainerStarted","Data":"da8b8e6f7e59661e65821e9bbdd04a34b573b16a1523cfd419898eef59656ffe"}
Sep 17 16:21:13.984714 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.984629    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8btrz"]
Sep 17 16:21:13.987188 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.987167    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:13.989802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.989779    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 16:21:13.990157 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.990138    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 16:21:13.991273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.990952    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 16:21:13.991273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.990979    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 16:21:13.991273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.991063    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 16:21:13.991273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.990958    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 16:21:13.991273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:13.991132    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-225z2\""
Sep 17 16:21:14.035040 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdk5n\" (UniqueName: \"kubernetes.io/projected/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-kube-api-access-wdk5n\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035194 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035194 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-wtmp\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-textfile\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-metrics-client-ca\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-root\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-tls\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.035599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.035497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-sys\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136595 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136553    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-sys\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136789 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdk5n\" (UniqueName: \"kubernetes.io/projected/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-kube-api-access-wdk5n\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136789 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136789 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-sys\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136789 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-wtmp\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136789 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-textfile\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.136789 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-metrics-client-ca\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.137081 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-root\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.137081 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-wtmp\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.137081 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.137081 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.136883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-tls\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.137081 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:21:14.137011    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 16:21:14.137081 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:21:14.137072    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-tls podName:41a2b0ec-75ae-4388-9764-a1cf812a3bbd nodeName:}" failed. No retries permitted until 2026-09-17 16:21:14.637050418 +0000 UTC m=+133.253946233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-tls") pod "node-exporter-8btrz" (UID: "41a2b0ec-75ae-4388-9764-a1cf812a3bbd") : secret "node-exporter-tls" not found
Sep 17 16:21:14.137374 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.137284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-root\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.137982 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.137960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-textfile\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.138191 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.138172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-metrics-client-ca\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.138588 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.138570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-accelerators-collector-config\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.139870 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.139832    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.151123 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.151103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdk5n\" (UniqueName: \"kubernetes.io/projected/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-kube-api-access-wdk5n\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.369882 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.369841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kn6qg" event={"ID":"fb2bcc30-f652-4940-86fb-dcc30bee1e11","Type":"ContainerStarted","Data":"624cf6d5e21e6957d3ceec88e34db3388ccb583c2e846f4c9c747f8c5961bbe7"}
Sep 17 16:21:14.370075 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.369899    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kn6qg" event={"ID":"fb2bcc30-f652-4940-86fb-dcc30bee1e11","Type":"ContainerStarted","Data":"1a0d7c1f565c25c99bde03dfda4c0bcee1f9c703108175344fc6675b7dfd3f98"}
Sep 17 16:21:14.390807 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.390759    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kn6qg" podStartSLOduration=130.917834032 podStartE2EDuration="2m12.390744039s" totalImagesPullingTime="1.472910007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:21:14.389273218 +0000 UTC m=+133.006169041" watchObservedRunningTime="2026-09-17 16:21:14.390744039 +0000 UTC m=+133.007639862"
Sep 17 16:21:14.641368 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.641270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-tls\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.643802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.643769    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41a2b0ec-75ae-4388-9764-a1cf812a3bbd-node-exporter-tls\") pod \"node-exporter-8btrz\" (UID: \"41a2b0ec-75ae-4388-9764-a1cf812a3bbd\") " pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.898597 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:14.898510    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8btrz"
Sep 17 16:21:14.907974 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:21:14.907943    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a2b0ec_75ae_4388_9764_a1cf812a3bbd.slice/crio-29d5934c396353cfe345f70fa3ba2e8cf53c8dbf8d17152858d51f5df1bbd3de WatchSource:0}: Error finding container 29d5934c396353cfe345f70fa3ba2e8cf53c8dbf8d17152858d51f5df1bbd3de: Status 404 returned error can't find the container with id 29d5934c396353cfe345f70fa3ba2e8cf53c8dbf8d17152858d51f5df1bbd3de
Sep 17 16:21:15.375560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:15.375521    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8btrz" event={"ID":"41a2b0ec-75ae-4388-9764-a1cf812a3bbd","Type":"ContainerStarted","Data":"29d5934c396353cfe345f70fa3ba2e8cf53c8dbf8d17152858d51f5df1bbd3de"}
Sep 17 16:21:16.380861 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:16.380825    2582 generic.go:356] "Generic (PLEG): container finished" podID="41a2b0ec-75ae-4388-9764-a1cf812a3bbd" containerID="e8d3dd8d3c4ea11708e3e21bd6b27655fd7971059f649046db78be8e53314b8b" exitCode=0
Sep 17 16:21:16.381264 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:16.380897    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8btrz" event={"ID":"41a2b0ec-75ae-4388-9764-a1cf812a3bbd","Type":"ContainerDied","Data":"e8d3dd8d3c4ea11708e3e21bd6b27655fd7971059f649046db78be8e53314b8b"}
Sep 17 16:21:17.386519 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:17.386481    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8btrz" event={"ID":"41a2b0ec-75ae-4388-9764-a1cf812a3bbd","Type":"ContainerStarted","Data":"5c1ca7561eed3573d495c3268922758ac12990df42e552110d3a5cc7080149d8"}
Sep 17 16:21:17.386996 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:17.386531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8btrz" event={"ID":"41a2b0ec-75ae-4388-9764-a1cf812a3bbd","Type":"ContainerStarted","Data":"9b5591a156b2fb798b4d3f705e6da897698cd6a52472544e43709818746b4d37"}
Sep 17 16:21:17.424212 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:17.424156    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8btrz" podStartSLOduration=3.438786582 podStartE2EDuration="4.424141676s" totalImagesPullingTime="915.615688ms" totalInitContainerRuntime="69.739406ms" isStatefulPod=true podCreationTimestamp="2026-09-17 16:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:21:17.422412424 +0000 UTC m=+136.039308243" watchObservedRunningTime="2026-09-17 16:21:17.424141676 +0000 UTC m=+136.041037544"
Sep 17 16:21:25.283427 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.283340    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" podUID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" containerName="registry" containerID="cri-o://c7791db90ad9df1ad96e176c88c9b547c9054e42798ff70e6eea28d63089b607" gracePeriod=30
Sep 17 16:21:25.416578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.416538    2582 generic.go:356] "Generic (PLEG): container finished" podID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" containerID="c7791db90ad9df1ad96e176c88c9b547c9054e42798ff70e6eea28d63089b607" exitCode=0
Sep 17 16:21:25.416718 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.416608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" event={"ID":"e9d19b92-2f7d-4b31-9b0f-295640f902ea","Type":"ContainerDied","Data":"c7791db90ad9df1ad96e176c88c9b547c9054e42798ff70e6eea28d63089b607"}
Sep 17 16:21:25.526208 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.526187    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:21:25.623564 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623482    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-image-registry-private-configuration\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623564 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623533    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9d19b92-2f7d-4b31-9b0f-295640f902ea-ca-trust-extracted\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623582    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-trusted-ca\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltkvv\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-kube-api-access-ltkvv\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623642    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-installation-pull-secrets\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623666    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-bound-sa-token\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.623767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.623745    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-certificates\") pod \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\" (UID: \"e9d19b92-2f7d-4b31-9b0f-295640f902ea\") "
Sep 17 16:21:25.624219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.624189    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:21:25.624589 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.624300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:21:25.626217 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.626186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:21:25.626217 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.626216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:21:25.626445 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.626314    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-kube-api-access-ltkvv" (OuterVolumeSpecName: "kube-api-access-ltkvv") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "kube-api-access-ltkvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:21:25.626687 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.626625    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:21:25.626687 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.626643    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:21:25.633184 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.633161    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d19b92-2f7d-4b31-9b0f-295640f902ea-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e9d19b92-2f7d-4b31-9b0f-295640f902ea" (UID: "e9d19b92-2f7d-4b31-9b0f-295640f902ea"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:21:25.725054 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725021    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-certificates\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725054 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725049    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-image-registry-private-configuration\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725054 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725059    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e9d19b92-2f7d-4b31-9b0f-295640f902ea-ca-trust-extracted\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725263 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725068    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e9d19b92-2f7d-4b31-9b0f-295640f902ea-trusted-ca\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725263 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725076    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltkvv\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-kube-api-access-ltkvv\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725263 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725084    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e9d19b92-2f7d-4b31-9b0f-295640f902ea-installation-pull-secrets\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725263 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725092    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:25.725263 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:25.725100    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e9d19b92-2f7d-4b31-9b0f-295640f902ea-bound-sa-token\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:21:26.420939 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:26.420908    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57895869b7-8dmq8"
Sep 17 16:21:26.421409 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:26.420913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57895869b7-8dmq8" event={"ID":"e9d19b92-2f7d-4b31-9b0f-295640f902ea","Type":"ContainerDied","Data":"b03877d3f3fcd5a1442194e31f2a93a4c9254f0beb0c241361d14992ff840f7d"}
Sep 17 16:21:26.421409 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:26.421033    2582 scope.go:117] "RemoveContainer" containerID="c7791db90ad9df1ad96e176c88c9b547c9054e42798ff70e6eea28d63089b607"
Sep 17 16:21:26.440638 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:26.440615    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57895869b7-8dmq8"]
Sep 17 16:21:26.446801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:26.446781    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57895869b7-8dmq8"]
Sep 17 16:21:27.856365 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:27.856327    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" path="/var/lib/kubelet/pods/e9d19b92-2f7d-4b31-9b0f-295640f902ea/volumes"
Sep 17 16:21:37.460764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:37.460732    2582 generic.go:356] "Generic (PLEG): container finished" podID="df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321" containerID="7d5c73059ada94e9438515c23d7735bdfd009234c59aa1aacf61dbdb9e092050" exitCode=0
Sep 17 16:21:37.461133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:37.460813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh" event={"ID":"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321","Type":"ContainerDied","Data":"7d5c73059ada94e9438515c23d7735bdfd009234c59aa1aacf61dbdb9e092050"}
Sep 17 16:21:37.461133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:37.461128    2582 scope.go:117] "RemoveContainer" containerID="7d5c73059ada94e9438515c23d7735bdfd009234c59aa1aacf61dbdb9e092050"
Sep 17 16:21:37.462286 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:37.462259    2582 generic.go:356] "Generic (PLEG): container finished" podID="fa1b07bb-2199-4972-a539-54b066669acb" containerID="555374b78127469c3c8f48c2b8348bfda07b4a4cdb4027f8ab1a9edce5a99174" exitCode=0
Sep 17 16:21:37.462437 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:37.462336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw" event={"ID":"fa1b07bb-2199-4972-a539-54b066669acb","Type":"ContainerDied","Data":"555374b78127469c3c8f48c2b8348bfda07b4a4cdb4027f8ab1a9edce5a99174"}
Sep 17 16:21:37.462627 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:37.462613    2582 scope.go:117] "RemoveContainer" containerID="555374b78127469c3c8f48c2b8348bfda07b4a4cdb4027f8ab1a9edce5a99174"
Sep 17 16:21:38.468026 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:38.467990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-zbkqh" event={"ID":"df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321","Type":"ContainerStarted","Data":"b12398f5f9689974f5165a2b80ec7f76c977649b9631baf956e5997c293740a7"}
Sep 17 16:21:38.469972 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:21:38.469944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p7mtw" event={"ID":"fa1b07bb-2199-4972-a539-54b066669acb","Type":"ContainerStarted","Data":"65f12a494f652601171a3737047890d7294977595f554c19d61ce8d7832b37ee"}
Sep 17 16:22:38.717698 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.717668    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"]
Sep 17 16:22:38.718196 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.717913    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" containerName="registry"
Sep 17 16:22:38.718196 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.717925    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" containerName="registry"
Sep 17 16:22:38.718196 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.717970    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9d19b92-2f7d-4b31-9b0f-295640f902ea" containerName="registry"
Sep 17 16:22:38.719864 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.719835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.722370 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.722342    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 16:22:38.722547 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.722529    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 16:22:38.722653 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.722631    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 16:22:38.722764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.722651    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-4ggcs\""
Sep 17 16:22:38.722764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.722653    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 16:22:38.722883 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.722770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 16:22:38.727667 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.727649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 16:22:38.732031 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-federate-client-tls\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-secret-telemeter-client\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732116    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-telemeter-client-tls\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-serving-certs-ca-bundle\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl7qf\" (UniqueName: \"kubernetes.io/projected/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-kube-api-access-vl7qf\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-metrics-client-ca\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.732311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.732281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.740597 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.740575    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"]
Sep 17 16:22:38.832666 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-federate-client-tls\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832666 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-secret-telemeter-client\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832925 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-telemeter-client-tls\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832925 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-serving-certs-ca-bundle\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832925 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl7qf\" (UniqueName: \"kubernetes.io/projected/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-kube-api-access-vl7qf\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832925 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-metrics-client-ca\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832925 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.832925 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.832856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.833638 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.833608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-metrics-client-ca\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.833769 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.833668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-serving-certs-ca-bundle\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.833992 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.833971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.835591 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.835567    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-secret-telemeter-client\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.835776 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.835758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-telemeter-client-tls\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.835856 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.835819    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.835856 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.835841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-federate-client-tls\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:38.844512 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:38.844491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl7qf\" (UniqueName: \"kubernetes.io/projected/fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9-kube-api-access-vl7qf\") pod \"telemeter-client-6944c64d5d-tbcnf\" (UID: \"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9\") " pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:39.029326 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:39.029295    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"
Sep 17 16:22:39.305657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:39.305632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6944c64d5d-tbcnf"]
Sep 17 16:22:39.308189 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:22:39.308161    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb3e8b2_6cb4_475c_adc5_9ea39472b8f9.slice/crio-41c16ed351d4599d0b64d8e405adf1f20b1b88a3731a975b96ffb4176be267bb WatchSource:0}: Error finding container 41c16ed351d4599d0b64d8e405adf1f20b1b88a3731a975b96ffb4176be267bb: Status 404 returned error can't find the container with id 41c16ed351d4599d0b64d8e405adf1f20b1b88a3731a975b96ffb4176be267bb
Sep 17 16:22:39.679629 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:39.679546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf" event={"ID":"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9","Type":"ContainerStarted","Data":"41c16ed351d4599d0b64d8e405adf1f20b1b88a3731a975b96ffb4176be267bb"}
Sep 17 16:22:41.686941 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:41.686901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf" event={"ID":"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9","Type":"ContainerStarted","Data":"3e611e5ff7aa2d60289ab0fbf75e1134d14c2453d39e5bc197e3b5f8c18fee24"}
Sep 17 16:22:44.700225 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:44.700188    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf" event={"ID":"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9","Type":"ContainerStarted","Data":"12a214083519c3414b83183155bd4184e82f73dbb3dd35935f2afceb1a28d192"}
Sep 17 16:22:44.700638 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:44.700242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf" event={"ID":"fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9","Type":"ContainerStarted","Data":"91ef29938808c19971cd126fb88d2783595186cfdf62da693433463c588c629a"}
Sep 17 16:22:44.734163 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:22:44.734111    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6944c64d5d-tbcnf" podStartSLOduration=1.9622732219999999 podStartE2EDuration="6.734094444s" totalImagesPullingTime="4.771821222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:22:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:22:44.732567004 +0000 UTC m=+223.349462827" watchObservedRunningTime="2026-09-17 16:22:44.734094444 +0000 UTC m=+223.350990265"
Sep 17 16:24:01.725221 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:24:01.725196    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:24:01.731544 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:24:01.731517    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:24:01.735164 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:24:01.735145    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 16:25:20.624578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.624498    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"]
Sep 17 16:25:20.627492 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.627476    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:20.630532 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.630509    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 17 16:25:20.634211 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.634192    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rthv9\""
Sep 17 16:25:20.634891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.634875    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 17 16:25:20.674603 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.674571    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"]
Sep 17 16:25:20.683555 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.683524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcvdc\" (UniqueName: \"kubernetes.io/projected/fe3d92ba-4b92-4505-b545-41bae05bfedd-kube-api-access-lcvdc\") pod \"feast-operator-controller-manager-847bc88cb4-nz98w\" (UID: \"fe3d92ba-4b92-4505-b545-41bae05bfedd\") " pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:20.784341 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.784297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcvdc\" (UniqueName: \"kubernetes.io/projected/fe3d92ba-4b92-4505-b545-41bae05bfedd-kube-api-access-lcvdc\") pod \"feast-operator-controller-manager-847bc88cb4-nz98w\" (UID: \"fe3d92ba-4b92-4505-b545-41bae05bfedd\") " pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:20.795092 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.795063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcvdc\" (UniqueName: \"kubernetes.io/projected/fe3d92ba-4b92-4505-b545-41bae05bfedd-kube-api-access-lcvdc\") pod \"feast-operator-controller-manager-847bc88cb4-nz98w\" (UID: \"fe3d92ba-4b92-4505-b545-41bae05bfedd\") " pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:20.937567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:20.937460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:21.212017 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:21.211947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"]
Sep 17 16:25:21.214611 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:25:21.214574    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3d92ba_4b92_4505_b545_41bae05bfedd.slice/crio-168cd17baa9b42a7f8cd6d7d66d0bae68f15ea8410da5077acc04dd3985330e7 WatchSource:0}: Error finding container 168cd17baa9b42a7f8cd6d7d66d0bae68f15ea8410da5077acc04dd3985330e7: Status 404 returned error can't find the container with id 168cd17baa9b42a7f8cd6d7d66d0bae68f15ea8410da5077acc04dd3985330e7
Sep 17 16:25:21.216633 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:21.216614    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:25:21.233547 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:21.233518    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w" event={"ID":"fe3d92ba-4b92-4505-b545-41bae05bfedd","Type":"ContainerStarted","Data":"168cd17baa9b42a7f8cd6d7d66d0bae68f15ea8410da5077acc04dd3985330e7"}
Sep 17 16:25:24.247931 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:24.247848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w" event={"ID":"fe3d92ba-4b92-4505-b545-41bae05bfedd","Type":"ContainerStarted","Data":"a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6"}
Sep 17 16:25:24.247931 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:24.247929    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:24.268776 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:24.268729    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w" podStartSLOduration=1.6852041309999999 podStartE2EDuration="4.268715192s" totalImagesPullingTime="2.583511061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:25:24.267302534 +0000 UTC m=+382.884198355" watchObservedRunningTime="2026-09-17 16:25:24.268715192 +0000 UTC m=+382.885611013"
Sep 17 16:25:35.254733 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:35.254700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:25:56.897792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.897753    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"]
Sep 17 16:25:56.901621 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.901604    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:56.904275 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904248    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 16:25:56.904588 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904266    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 16:25:56.904810 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 16:25:56.904810 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 17 16:25:56.904969 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904673    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 16:25:56.904969 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904685    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 16:25:56.904969 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904708    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ns9c9\""
Sep 17 16:25:56.905113 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.904751    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 16:25:56.913807 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.913782    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"]
Sep 17 16:25:56.962438 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.962399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-feast-data\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:56.962438 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.962446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-offline-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:56.962652 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.962462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:56.962652 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.962476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:56.962652 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.962506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqf4v\" (UniqueName: \"kubernetes.io/projected/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-kube-api-access-pqf4v\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:56.962652 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:56.962565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-registry-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.063572 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.063535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-registry-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.063583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-feast-data\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.063600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-offline-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.063616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.063640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.063689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqf4v\" (UniqueName: \"kubernetes.io/projected/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-kube-api-access-pqf4v\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:25:57.063742    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:25:57.063828    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls podName:784fbcfc-a973-4db0-be8a-c3a93b1a4c1d nodeName:}" failed. No retries permitted until 2026-09-17 16:25:57.563808724 +0000 UTC m=+416.180704524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls") pod "feast-simple-feast-setup-58dbd9cc7f-q87bc" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:25:57.063840    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:25:57.064053 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:25:57.063919    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls podName:784fbcfc-a973-4db0-be8a-c3a93b1a4c1d nodeName:}" failed. No retries permitted until 2026-09-17 16:25:57.563900698 +0000 UTC m=+416.180796511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls") pod "feast-simple-feast-setup-58dbd9cc7f-q87bc" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:25:57.064564 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.064059    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-feast-data\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.066419 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.066372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-registry-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.066518 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.066375    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-offline-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.074980 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.074948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqf4v\" (UniqueName: \"kubernetes.io/projected/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-kube-api-access-pqf4v\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.567459 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.567428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.567459 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.567462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.570145 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.570115    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.570145 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.570135    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-q87bc\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:57.819599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:57.819516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:25:58.103245 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:58.103222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"]
Sep 17 16:25:58.104746 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:25:58.104719    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod784fbcfc_a973_4db0_be8a_c3a93b1a4c1d.slice/crio-c5f687c6b5152780ce6d30f762e5b6e85bce25b24be63f6d67bbe15a507f9c21 WatchSource:0}: Error finding container c5f687c6b5152780ce6d30f762e5b6e85bce25b24be63f6d67bbe15a507f9c21: Status 404 returned error can't find the container with id c5f687c6b5152780ce6d30f762e5b6e85bce25b24be63f6d67bbe15a507f9c21
Sep 17 16:25:58.369735 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:25:58.369648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"c5f687c6b5152780ce6d30f762e5b6e85bce25b24be63f6d67bbe15a507f9c21"}
Sep 17 16:26:28.496173 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:28.496117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"}
Sep 17 16:26:32.511470 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:32.511436    2582 generic.go:356] "Generic (PLEG): container finished" podID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerID="70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b" exitCode=0
Sep 17 16:26:32.511827 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:32.511499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"}
Sep 17 16:26:33.517940 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:33.517901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"}
Sep 17 16:26:38.537160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:38.537122    2582 generic.go:356] "Generic (PLEG): container finished" podID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerID="392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f" exitCode=0
Sep 17 16:26:38.537558 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:38.537172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"}
Sep 17 16:26:38.546020 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:38.546002    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 17 16:26:39.547171 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.547127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"}
Sep 17 16:26:39.547660 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.547191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"}
Sep 17 16:26:39.547660 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.547210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"}
Sep 17 16:26:39.547660 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.547225    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerStarted","Data":"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"}
Sep 17 16:26:39.580417 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.580321    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podStartSLOduration=14.081316433 podStartE2EDuration="43.580296401s" totalImagesPullingTime="29.498979968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:26:39.577589111 +0000 UTC m=+458.194484935" watchObservedRunningTime="2026-09-17 16:26:39.580296401 +0000 UTC m=+458.197192224"
Sep 17 16:26:39.819951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.819848    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:39.819951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.819915    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:39.819951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.819937    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:39.819951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.819955    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:39.822054 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.822014    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused"
Sep 17 16:26:39.822203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.822056    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
Sep 17 16:26:39.822203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.822028    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
Sep 17 16:26:39.822203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:39.822028    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused"
Sep 17 16:26:42.820598 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:42.820547    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused"
Sep 17 16:26:42.820598 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:42.820578    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused"
Sep 17 16:26:42.821137 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:42.820614    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
Sep 17 16:26:42.821239 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:42.820573    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
Sep 17 16:26:45.820791 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:45.820739    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
Sep 17 16:26:45.821234 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:45.820741    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.19:6571: connect: connection refused"
Sep 17 16:26:45.821234 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:45.820740    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
Sep 17 16:26:45.821234 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:45.820914    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused"
Sep 17 16:26:47.820491 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:47.820451    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:47.820877 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:47.820507    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:47.820877 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:47.820520    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:47.820877 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:47.820532    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.821475 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.821444    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.821909 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.821545    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.821909 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.821830    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.822535 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.822514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.822687 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.822664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.822795 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.822713    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:48.828284 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:48.828263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:26:49.595343 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:26:49.595309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:27:51.141071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.141038    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"]
Sep 17 16:27:51.141653 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.141281    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry" containerID="cri-o://3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8" gracePeriod=30
Sep 17 16:27:51.141653 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.141448    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline" containerID="cri-o://c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d" gracePeriod=30
Sep 17 16:27:51.141653 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.141470    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" containerID="cri-o://eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178" gracePeriod=30
Sep 17 16:27:51.141653 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.141582    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" containerID="cri-o://dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f" gracePeriod=30
Sep 17 16:27:51.570757 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.570715    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"]
Sep 17 16:27:51.575253 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.575229    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.578011 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.577969    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8lm8t\""
Sep 17 16:27:51.590853 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.590817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"]
Sep 17 16:27:51.626140 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.626101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.626140 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.626149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-feast-data\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.626410 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.626181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-offline-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.626410 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.626239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.626410 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.626267    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kprt\" (UniqueName: \"kubernetes.io/projected/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-kube-api-access-6kprt\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.626410 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.626313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-registry-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.727686 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.727651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.727893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.727696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-feast-data\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.727893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.727727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-offline-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.727893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.727760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.727893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.727794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kprt\" (UniqueName: \"kubernetes.io/projected/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-kube-api-access-6kprt\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.727893 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:27:51.727835    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:27:51.728256 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:27:51.727942    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls podName:25e3daf9-1a13-4e33-98ac-c920ccf1bed6 nodeName:}" failed. No retries permitted until 2026-09-17 16:27:52.227919889 +0000 UTC m=+530.844815690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls") pod "feast-simple-feast-setup-58dbd9cc7f-gxj9k" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:27:51.728256 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.727847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-registry-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.728256 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.728166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-feast-data\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.728453 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:27:51.728260    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:27:51.728453 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:27:51.728303    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls podName:25e3daf9-1a13-4e33-98ac-c920ccf1bed6 nodeName:}" failed. No retries permitted until 2026-09-17 16:27:52.228288616 +0000 UTC m=+530.845184417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls") pod "feast-simple-feast-setup-58dbd9cc7f-gxj9k" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:27:51.730858 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.730835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-offline-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.731019 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.730946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-registry-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:51.739532 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:51.739507    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kprt\" (UniqueName: \"kubernetes.io/projected/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-kube-api-access-6kprt\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:52.234079 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.233965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:52.234079 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.234051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:52.236567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.236544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:52.236668 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.236554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls\") pod \"feast-simple-feast-setup-58dbd9cc7f-gxj9k\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") " pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:52.487895 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.487806    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:27:52.770850 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.770820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"]
Sep 17 16:27:52.772571 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:27:52.772533    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25e3daf9_1a13_4e33_98ac_c920ccf1bed6.slice/crio-73c2cde6e0ab84f3229f79ab36bde6c07a3db6a5c4d045d1151308c6b9d3a4de WatchSource:0}: Error finding container 73c2cde6e0ab84f3229f79ab36bde6c07a3db6a5c4d045d1151308c6b9d3a4de: Status 404 returned error can't find the container with id 73c2cde6e0ab84f3229f79ab36bde6c07a3db6a5c4d045d1151308c6b9d3a4de
Sep 17 16:27:52.825640 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.825613    2582 generic.go:356] "Generic (PLEG): container finished" podID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerID="dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f" exitCode=0
Sep 17 16:27:52.825640 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.825635    2582 generic.go:356] "Generic (PLEG): container finished" podID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerID="eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178" exitCode=0
Sep 17 16:27:52.825822 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.825682    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"}
Sep 17 16:27:52.825822 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.825723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"}
Sep 17 16:27:52.827111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:52.827090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"73c2cde6e0ab84f3229f79ab36bde6c07a3db6a5c4d045d1151308c6b9d3a4de"}
Sep 17 16:27:53.832307 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:53.832225    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"}
Sep 17 16:27:57.847840 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:57.847806    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerID="546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560" exitCode=0
Sep 17 16:27:57.848199 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:57.847880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"}
Sep 17 16:27:58.823271 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:58.823216    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
Sep 17 16:27:58.854765 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:58.854727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"}
Sep 17 16:27:59.593304 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:27:59.593254    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
Sep 17 16:28:03.881096 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:03.881060    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerID="dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634" exitCode=0
Sep 17 16:28:03.881464 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:03.881133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"}
Sep 17 16:28:04.891151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:04.891112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"}
Sep 17 16:28:04.891679 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:04.891178    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"}
Sep 17 16:28:04.891679 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:04.891199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"}
Sep 17 16:28:04.891679 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:04.891220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerStarted","Data":"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"}
Sep 17 16:28:04.922197 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:04.922119    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podStartSLOduration=13.922079697000001 podStartE2EDuration="13.922079697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:28:04.921665932 +0000 UTC m=+543.538561755" watchObservedRunningTime="2026-09-17 16:28:04.922079697 +0000 UTC m=+543.538975525"
Sep 17 16:28:07.489006 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.488959    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:07.489542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.489025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:07.489542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.489046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:07.489542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.489066    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:07.491266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.491115    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
Sep 17 16:28:07.491266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.491167    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
Sep 17 16:28:07.491266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.491128    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.20:6571: connect: connection refused"
Sep 17 16:28:07.491266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:07.491178    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.20:8816: connect: connection refused"
Sep 17 16:28:08.823022 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:08.822972    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
Sep 17 16:28:09.592939 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:09.592890    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
Sep 17 16:28:10.488456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:10.488384    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.20:8816: connect: connection refused"
Sep 17 16:28:10.488456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:10.488434    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
Sep 17 16:28:10.489064 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:10.488434    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
Sep 17 16:28:10.489064 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:10.489011    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.20:6571: connect: connection refused"
Sep 17 16:28:12.488340 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:12.488299    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:12.488750 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:12.488360    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:12.488750 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:12.488374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:12.488750 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:12.488410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.489578 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.489544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.490071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.489934    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.490139 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.490112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.490762 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.490739    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.490926 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.490913    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.491522 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.491505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.495082 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.495066    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:13.940888 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:13.940857    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:28:18.822862 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:18.822805    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused"
Sep 17 16:28:18.823301 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:18.822990    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:28:19.592804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:19.592764    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused"
Sep 17 16:28:19.592990 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:19.592880    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:28:21.787849 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.787824    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:28:21.887287 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-feast-data\") pod \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") "
Sep 17 16:28:21.887287 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887292    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqf4v\" (UniqueName: \"kubernetes.io/projected/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-kube-api-access-pqf4v\") pod \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") "
Sep 17 16:28:21.887522 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887309    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-registry-tls\") pod \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") "
Sep 17 16:28:21.887522 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887332    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls\") pod \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") "
Sep 17 16:28:21.887522 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887354    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-offline-tls\") pod \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") "
Sep 17 16:28:21.887522 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887436    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls\") pod \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\" (UID: \"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d\") "
Sep 17 16:28:21.887845 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.887816    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-feast-data" (OuterVolumeSpecName: "feast-data") pod "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:28:21.889867 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.889843    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:28:21.889984 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.889863    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls" (OuterVolumeSpecName: "online-tls") pod "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:28:21.889984 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.889884    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-kube-api-access-pqf4v" (OuterVolumeSpecName: "kube-api-access-pqf4v") pod "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d"). InnerVolumeSpecName "kube-api-access-pqf4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:28:21.890105 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.890086    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:28:21.890167 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.890151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" (UID: "784fbcfc-a973-4db0-be8a-c3a93b1a4c1d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:28:21.969432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969330    2582 generic.go:356] "Generic (PLEG): container finished" podID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerID="c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d" exitCode=137
Sep 17 16:28:21.969432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969356    2582 generic.go:356] "Generic (PLEG): container finished" podID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerID="3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8" exitCode=137
Sep 17 16:28:21.969432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969426    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"
Sep 17 16:28:21.969655 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"}
Sep 17 16:28:21.969655 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"}
Sep 17 16:28:21.969655 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969502    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc" event={"ID":"784fbcfc-a973-4db0-be8a-c3a93b1a4c1d","Type":"ContainerDied","Data":"c5f687c6b5152780ce6d30f762e5b6e85bce25b24be63f6d67bbe15a507f9c21"}
Sep 17 16:28:21.969655 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.969522    2582 scope.go:117] "RemoveContainer" containerID="dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"
Sep 17 16:28:21.977982 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.977968    2582 scope.go:117] "RemoveContainer" containerID="c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"
Sep 17 16:28:21.985383 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.985362    2582 scope.go:117] "RemoveContainer" containerID="eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"
Sep 17 16:28:21.988843 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.988787    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:28:21.988843 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.988813    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:28:21.988843 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.988825    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:28:21.988843 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.988838    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqf4v\" (UniqueName: \"kubernetes.io/projected/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-kube-api-access-pqf4v\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:28:21.989031 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.988851    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:28:21.989031 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.988862    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:28:21.992793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:21.992765    2582 scope.go:117] "RemoveContainer" containerID="3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"
Sep 17 16:28:22.000218 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.000199    2582 scope.go:117] "RemoveContainer" containerID="392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"
Sep 17 16:28:22.006245 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.006220    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"]
Sep 17 16:28:22.007969 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.007955    2582 scope.go:117] "RemoveContainer" containerID="70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"
Sep 17 16:28:22.016709 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.016678    2582 scope.go:117] "RemoveContainer" containerID="dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"
Sep 17 16:28:22.017084 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:28:22.017059    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f\": container with ID starting with dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f not found: ID does not exist" containerID="dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"
Sep 17 16:28:22.017187 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.017088    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"} err="failed to get container status \"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f\": rpc error: code = NotFound desc = could not find container \"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f\": container with ID starting with dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f not found: ID does not exist"
Sep 17 16:28:22.017187 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.017120    2582 scope.go:117] "RemoveContainer" containerID="c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"
Sep 17 16:28:22.017507 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:28:22.017434    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d\": container with ID starting with c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d not found: ID does not exist" containerID="c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"
Sep 17 16:28:22.017507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.017464    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"} err="failed to get container status \"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d\": rpc error: code = NotFound desc = could not find container \"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d\": container with ID starting with c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d not found: ID does not exist"
Sep 17 16:28:22.017507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.017480    2582 scope.go:117] "RemoveContainer" containerID="eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"
Sep 17 16:28:22.017845 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:28:22.017822    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178\": container with ID starting with eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178 not found: ID does not exist" containerID="eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"
Sep 17 16:28:22.017994 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.017967    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"} err="failed to get container status \"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178\": rpc error: code = NotFound desc = could not find container \"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178\": container with ID starting with eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178 not found: ID does not exist"
Sep 17 16:28:22.018079 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.017997    2582 scope.go:117] "RemoveContainer" containerID="3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"
Sep 17 16:28:22.018506 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:28:22.018469    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8\": container with ID starting with 3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8 not found: ID does not exist" containerID="3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"
Sep 17 16:28:22.018639 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.018619    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"} err="failed to get container status \"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8\": rpc error: code = NotFound desc = could not find container \"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8\": container with ID starting with 3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8 not found: ID does not exist"
Sep 17 16:28:22.018721 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.018710    2582 scope.go:117] "RemoveContainer" containerID="392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"
Sep 17 16:28:22.019202 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:28:22.019179    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f\": container with ID starting with 392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f not found: ID does not exist" containerID="392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"
Sep 17 16:28:22.019288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.019209    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"} err="failed to get container status \"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f\": rpc error: code = NotFound desc = could not find container \"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f\": container with ID starting with 392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f not found: ID does not exist"
Sep 17 16:28:22.019288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.019224    2582 scope.go:117] "RemoveContainer" containerID="70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"
Sep 17 16:28:22.019545 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:28:22.019526    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b\": container with ID starting with 70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b not found: ID does not exist" containerID="70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"
Sep 17 16:28:22.019614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.019547    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"} err="failed to get container status \"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b\": rpc error: code = NotFound desc = could not find container \"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b\": container with ID starting with 70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b not found: ID does not exist"
Sep 17 16:28:22.019614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.019560    2582 scope.go:117] "RemoveContainer" containerID="dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"
Sep 17 16:28:22.019881 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.019859    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f"} err="failed to get container status \"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f\": rpc error: code = NotFound desc = could not find container \"dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f\": container with ID starting with dd384adfce20ed3e91f88d828126274af424c2c200d79ef9ada432426360d76f not found: ID does not exist"
Sep 17 16:28:22.019881 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.019880    2582 scope.go:117] "RemoveContainer" containerID="c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"
Sep 17 16:28:22.020178 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.020143    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d"} err="failed to get container status \"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d\": rpc error: code = NotFound desc = could not find container \"c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d\": container with ID starting with c72226d90840e96546292b1cf38483c837be13614b679016a09458247e426e5d not found: ID does not exist"
Sep 17 16:28:22.020178 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.020176    2582 scope.go:117] "RemoveContainer" containerID="eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"
Sep 17 16:28:22.020474 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.020454    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178"} err="failed to get container status \"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178\": rpc error: code = NotFound desc = could not find container \"eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178\": container with ID starting with eaba2bde7e120fb8c8cf14119435643c0216bbf5ed38cdbfe2c1434440ec9178 not found: ID does not exist"
Sep 17 16:28:22.020560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.020483    2582 scope.go:117] "RemoveContainer" containerID="3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"
Sep 17 16:28:22.020815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.020778    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8"} err="failed to get container status \"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8\": rpc error: code = NotFound desc = could not find container \"3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8\": container with ID starting with 3dea4fb8b0285e56979deeb59569f733b7cdb0bc95c2ea1b3d9effb7b1bd6de8 not found: ID does not exist"
Sep 17 16:28:22.020914 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.020817    2582 scope.go:117] "RemoveContainer" containerID="392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"
Sep 17 16:28:22.021236 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.021141    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f"} err="failed to get container status \"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f\": rpc error: code = NotFound desc = could not find container \"392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f\": container with ID starting with 392730bd7cf8f838922204f5d8e9470266736d170bcec9b2c53dcff5e967961f not found: ID does not exist"
Sep 17 16:28:22.021236 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.021162    2582 scope.go:117] "RemoveContainer" containerID="70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"
Sep 17 16:28:22.021486 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.021458    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b"} err="failed to get container status \"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b\": rpc error: code = NotFound desc = could not find container \"70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b\": container with ID starting with 70ff386ec1e25a7ac9e33293c651f05bb7fa53434b342da26600690e850e2d1b not found: ID does not exist"
Sep 17 16:28:22.021561 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:22.021495    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-q87bc"]
Sep 17 16:28:23.856089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:28:23.856051    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" path="/var/lib/kubelet/pods/784fbcfc-a973-4db0-be8a-c3a93b1a4c1d/volumes"
Sep 17 16:29:01.749914 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:01.749885    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:29:01.754266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:01.754245    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:29:16.628323 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628284    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"]
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628695    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628709    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628722    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="feast-init"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628731    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="feast-init"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628739    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628748    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628763    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry"
Sep 17 16:29:16.628772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628771    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628786    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="feast-apply"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628795    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="feast-apply"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628819    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628827    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628892    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="online"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628903    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="ui"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628911    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="offline"
Sep 17 16:29:16.629046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.628922    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="784fbcfc-a973-4db0-be8a-c3a93b1a4c1d" containerName="registry"
Sep 17 16:29:16.633886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.633863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.636527 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.636505    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 16:29:16.636660 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.636640    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-k2pmv\""
Sep 17 16:29:16.636731 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.636647    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 16:29:16.636955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.636935    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 16:29:16.637102 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.637084    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 16:29:16.637180 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.637085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 16:29:16.637238 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.637035    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 17 16:29:16.637708 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.637689    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 16:29:16.645033 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.645009    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"]
Sep 17 16:29:16.693342 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.693307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-offline-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.693342 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.693343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/982c5d89-538b-4df5-83fb-13656b9617e3-feast-data\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.693561 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.693412    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbh9\" (UniqueName: \"kubernetes.io/projected/982c5d89-538b-4df5-83fb-13656b9617e3-kube-api-access-5rbh9\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.693561 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.693458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/982c5d89-538b-4df5-83fb-13656b9617e3-registry-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.693561 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.693480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-online-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.693561 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.693511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-ui-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.793988 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.793951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-ui-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.794155 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.793997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-offline-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.794155 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.794021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/982c5d89-538b-4df5-83fb-13656b9617e3-feast-data\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.794225 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.794206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbh9\" (UniqueName: \"kubernetes.io/projected/982c5d89-538b-4df5-83fb-13656b9617e3-kube-api-access-5rbh9\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.794258 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.794249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/982c5d89-538b-4df5-83fb-13656b9617e3-registry-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.794307 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.794276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-online-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.794515 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.794489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/982c5d89-538b-4df5-83fb-13656b9617e3-feast-data\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.795207 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.795179    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/982c5d89-538b-4df5-83fb-13656b9617e3-registry-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.796677 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.796647    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-offline-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.796759 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.796683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-online-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.796759 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.796698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-ui-tls\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.804189 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.804166    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbh9\" (UniqueName: \"kubernetes.io/projected/982c5d89-538b-4df5-83fb-13656b9617e3-kube-api-access-5rbh9\") pod \"feast-simple-feast-remote-setup-57f58ddb87-2wvn6\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:16.944962 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:16.944872    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:17.226237 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:17.226159    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"]
Sep 17 16:29:17.229338 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:29:17.229302    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod982c5d89_538b_4df5_83fb_13656b9617e3.slice/crio-49c10b759b5b6ef4856ef58cb497792ae0ca2ca0b774b381f2918e9a6cdc180b WatchSource:0}: Error finding container 49c10b759b5b6ef4856ef58cb497792ae0ca2ca0b774b381f2918e9a6cdc180b: Status 404 returned error can't find the container with id 49c10b759b5b6ef4856ef58cb497792ae0ca2ca0b774b381f2918e9a6cdc180b
Sep 17 16:29:18.175036 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:18.174992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerStarted","Data":"d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1"}
Sep 17 16:29:18.175442 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:18.175062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerStarted","Data":"49c10b759b5b6ef4856ef58cb497792ae0ca2ca0b774b381f2918e9a6cdc180b"}
Sep 17 16:29:22.193507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:22.193473    2582 generic.go:356] "Generic (PLEG): container finished" podID="982c5d89-538b-4df5-83fb-13656b9617e3" containerID="d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1" exitCode=0
Sep 17 16:29:22.193833 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:22.193522    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerDied","Data":"d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1"}
Sep 17 16:29:23.199607 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:23.199525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerStarted","Data":"c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568"}
Sep 17 16:29:49.306844 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:49.306806    2582 generic.go:356] "Generic (PLEG): container finished" podID="982c5d89-538b-4df5-83fb-13656b9617e3" containerID="c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568" exitCode=0
Sep 17 16:29:49.307249 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:49.306880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerDied","Data":"c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568"}
Sep 17 16:29:50.315764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:50.315732    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerStarted","Data":"a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe"}
Sep 17 16:29:50.316236 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:50.315780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerStarted","Data":"16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7"}
Sep 17 16:29:50.316236 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:50.315794    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerStarted","Data":"6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858"}
Sep 17 16:29:50.349872 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:50.349796    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podStartSLOduration=34.349776465 podStartE2EDuration="34.349776465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:29:50.348988235 +0000 UTC m=+648.965884059" watchObservedRunningTime="2026-09-17 16:29:50.349776465 +0000 UTC m=+648.966672288"
Sep 17 16:29:52.945373 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:52.945338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:52.945957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:52.945930    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:52.945957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:52.945961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:52.947370 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:52.947329    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Sep 17 16:29:52.947498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:52.947360    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused"
Sep 17 16:29:52.947498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:52.947430    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Sep 17 16:29:55.946186 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:55.946139    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused"
Sep 17 16:29:55.946186 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:55.946166    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Sep 17 16:29:55.946722 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:55.946140    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Sep 17 16:29:56.945946 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:56.945896    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:56.946115 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:56.945971    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:56.946115 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:56.945991    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:58.946314 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:58.946274    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:58.946771 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:58.946409    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:58.947149 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:58.947126    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:58.947284 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:58.947269    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:58.971548 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:58.971519    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:29:59.382484 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:29:59.382455    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:31:00.897775 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:00.897699    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"]
Sep 17 16:31:00.898200 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:00.897941    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online" containerID="cri-o://6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858" gracePeriod=30
Sep 17 16:31:00.898200 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:00.897996    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui" containerID="cri-o://a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe" gracePeriod=30
Sep 17 16:31:00.898200 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:00.898015    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="offline" containerID="cri-o://16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7" gracePeriod=30
Sep 17 16:31:01.049623 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:01.049594    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"]
Sep 17 16:31:01.049892 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:01.049845    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="registry" containerID="cri-o://122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52" gracePeriod=30
Sep 17 16:31:01.049992 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:01.049921    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui" containerID="cri-o://e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c" gracePeriod=30
Sep 17 16:31:01.049992 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:01.049917    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="offline" containerID="cri-o://4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579" gracePeriod=30
Sep 17 16:31:01.050177 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:01.050132    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online" containerID="cri-o://84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f" gracePeriod=30
Sep 17 16:31:02.608802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.608767    2582 generic.go:356] "Generic (PLEG): container finished" podID="982c5d89-538b-4df5-83fb-13656b9617e3" containerID="a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe" exitCode=0
Sep 17 16:31:02.608802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.608793    2582 generic.go:356] "Generic (PLEG): container finished" podID="982c5d89-538b-4df5-83fb-13656b9617e3" containerID="6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858" exitCode=0
Sep 17 16:31:02.609240 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.608830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerDied","Data":"a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe"}
Sep 17 16:31:02.609240 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.608872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerDied","Data":"6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858"}
Sep 17 16:31:02.611854 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.611829    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerID="e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c" exitCode=0
Sep 17 16:31:02.611854 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.611852    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerID="84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f" exitCode=0
Sep 17 16:31:02.612015 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.611902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"}
Sep 17 16:31:02.612015 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:02.611938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"}
Sep 17 16:31:03.490822 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:03.490773    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
Sep 17 16:31:03.938645 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:03.938609    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
Sep 17 16:31:08.947270 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:08.947220    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Sep 17 16:31:09.359846 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:09.359800    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Sep 17 16:31:13.491120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:13.491068    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
Sep 17 16:31:13.937865 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:13.937821    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
Sep 17 16:31:18.947697 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:18.947649    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Sep 17 16:31:19.359360 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:19.359324    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Sep 17 16:31:23.491027 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:23.490976    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.20:8443: connect: connection refused"
Sep 17 16:31:23.491505 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:23.491119    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:31:23.938220 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:23.938180    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.20:6567/health\": dial tcp 10.133.0.20:6567: connect: connection refused"
Sep 17 16:31:23.938430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:23.938298    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:31:28.947141 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:28.947094    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused"
Sep 17 16:31:28.947576 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:28.947214    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:31:29.359719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:29.359680    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused"
Sep 17 16:31:29.359891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:29.359844    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:31:31.550412 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.550365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:31:31.650080 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-ui-tls\") pod \"982c5d89-538b-4df5-83fb-13656b9617e3\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") "
Sep 17 16:31:31.650262 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650110    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rbh9\" (UniqueName: \"kubernetes.io/projected/982c5d89-538b-4df5-83fb-13656b9617e3-kube-api-access-5rbh9\") pod \"982c5d89-538b-4df5-83fb-13656b9617e3\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") "
Sep 17 16:31:31.650262 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650129    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-online-tls\") pod \"982c5d89-538b-4df5-83fb-13656b9617e3\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") "
Sep 17 16:31:31.650262 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650153    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/982c5d89-538b-4df5-83fb-13656b9617e3-feast-data\") pod \"982c5d89-538b-4df5-83fb-13656b9617e3\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") "
Sep 17 16:31:31.650262 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650176    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/982c5d89-538b-4df5-83fb-13656b9617e3-registry-tls\") pod \"982c5d89-538b-4df5-83fb-13656b9617e3\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") "
Sep 17 16:31:31.650481 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650362    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-offline-tls\") pod \"982c5d89-538b-4df5-83fb-13656b9617e3\" (UID: \"982c5d89-538b-4df5-83fb-13656b9617e3\") "
Sep 17 16:31:31.650585 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650545    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/982c5d89-538b-4df5-83fb-13656b9617e3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "982c5d89-538b-4df5-83fb-13656b9617e3" (UID: "982c5d89-538b-4df5-83fb-13656b9617e3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:31:31.650693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650663    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/982c5d89-538b-4df5-83fb-13656b9617e3-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.650752 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.650709    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982c5d89-538b-4df5-83fb-13656b9617e3-feast-data" (OuterVolumeSpecName: "feast-data") pod "982c5d89-538b-4df5-83fb-13656b9617e3" (UID: "982c5d89-538b-4df5-83fb-13656b9617e3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:31:31.652555 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.652530    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982c5d89-538b-4df5-83fb-13656b9617e3-kube-api-access-5rbh9" (OuterVolumeSpecName: "kube-api-access-5rbh9") pod "982c5d89-538b-4df5-83fb-13656b9617e3" (UID: "982c5d89-538b-4df5-83fb-13656b9617e3"). InnerVolumeSpecName "kube-api-access-5rbh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:31:31.652686 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.652589    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "982c5d89-538b-4df5-83fb-13656b9617e3" (UID: "982c5d89-538b-4df5-83fb-13656b9617e3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.652929 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.652903    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-online-tls" (OuterVolumeSpecName: "online-tls") pod "982c5d89-538b-4df5-83fb-13656b9617e3" (UID: "982c5d89-538b-4df5-83fb-13656b9617e3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.652929 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.652919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "982c5d89-538b-4df5-83fb-13656b9617e3" (UID: "982c5d89-538b-4df5-83fb-13656b9617e3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.692288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.692265    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:31:31.727355 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.727320    2582 generic.go:356] "Generic (PLEG): container finished" podID="982c5d89-538b-4df5-83fb-13656b9617e3" containerID="16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7" exitCode=137
Sep 17 16:31:31.727516 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.727413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerDied","Data":"16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7"}
Sep 17 16:31:31.727516 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.727429    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"
Sep 17 16:31:31.727516 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.727456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6" event={"ID":"982c5d89-538b-4df5-83fb-13656b9617e3","Type":"ContainerDied","Data":"49c10b759b5b6ef4856ef58cb497792ae0ca2ca0b774b381f2918e9a6cdc180b"}
Sep 17 16:31:31.727516 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.727480    2582 scope.go:117] "RemoveContainer" containerID="a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe"
Sep 17 16:31:31.730754 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.730732    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerID="4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579" exitCode=137
Sep 17 16:31:31.730754 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.730750    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerID="122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52" exitCode=137
Sep 17 16:31:31.730955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.730800    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"
Sep 17 16:31:31.730955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.730813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"}
Sep 17 16:31:31.730955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.730863    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"}
Sep 17 16:31:31.730955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.730884    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k" event={"ID":"25e3daf9-1a13-4e33-98ac-c920ccf1bed6","Type":"ContainerDied","Data":"73c2cde6e0ab84f3229f79ab36bde6c07a3db6a5c4d045d1151308c6b9d3a4de"}
Sep 17 16:31:31.736241 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.736219    2582 scope.go:117] "RemoveContainer" containerID="16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7"
Sep 17 16:31:31.744153 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.744134    2582 scope.go:117] "RemoveContainer" containerID="6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858"
Sep 17 16:31:31.751336 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-feast-data\") pod \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") "
Sep 17 16:31:31.751336 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751323    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls\") pod \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") "
Sep 17 16:31:31.751489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751350    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kprt\" (UniqueName: \"kubernetes.io/projected/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-kube-api-access-6kprt\") pod \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") "
Sep 17 16:31:31.751489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751359    2582 scope.go:117] "RemoveContainer" containerID="c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568"
Sep 17 16:31:31.751489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls\") pod \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") "
Sep 17 16:31:31.751489 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751457    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-offline-tls\") pod \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") "
Sep 17 16:31:31.751693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-registry-tls\") pod \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\" (UID: \"25e3daf9-1a13-4e33-98ac-c920ccf1bed6\") "
Sep 17 16:31:31.751788 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751690    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.751788 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751707    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/982c5d89-538b-4df5-83fb-13656b9617e3-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.751788 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751719    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.751788 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751732    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/982c5d89-538b-4df5-83fb-13656b9617e3-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.751788 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751744    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rbh9\" (UniqueName: \"kubernetes.io/projected/982c5d89-538b-4df5-83fb-13656b9617e3-kube-api-access-5rbh9\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.752008 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.751838    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-feast-data" (OuterVolumeSpecName: "feast-data") pod "25e3daf9-1a13-4e33-98ac-c920ccf1bed6" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:31:31.755366 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.755343    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"]
Sep 17 16:31:31.760020 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.760000    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-57f58ddb87-2wvn6"]
Sep 17 16:31:31.761253 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.761233    2582 scope.go:117] "RemoveContainer" containerID="d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1"
Sep 17 16:31:31.768289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.768270    2582 scope.go:117] "RemoveContainer" containerID="a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe"
Sep 17 16:31:31.768595 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.768574    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe\": container with ID starting with a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe not found: ID does not exist" containerID="a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe"
Sep 17 16:31:31.768642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.768608    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe"} err="failed to get container status \"a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe\": rpc error: code = NotFound desc = could not find container \"a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe\": container with ID starting with a6e705a108a38384e2bc7e24f4de9ad7846919547fd20ad5432914b6366fe2fe not found: ID does not exist"
Sep 17 16:31:31.768642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.768626    2582 scope.go:117] "RemoveContainer" containerID="16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7"
Sep 17 16:31:31.768892 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.768875    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7\": container with ID starting with 16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7 not found: ID does not exist" containerID="16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7"
Sep 17 16:31:31.768946 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.768897    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7"} err="failed to get container status \"16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7\": rpc error: code = NotFound desc = could not find container \"16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7\": container with ID starting with 16b5496245a8dede9d5d7770a2ba56d5d4820b54a87da89ad9308a3a218089c7 not found: ID does not exist"
Sep 17 16:31:31.768946 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.768910    2582 scope.go:117] "RemoveContainer" containerID="6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858"
Sep 17 16:31:31.769171 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.769154    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858\": container with ID starting with 6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858 not found: ID does not exist" containerID="6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858"
Sep 17 16:31:31.769230 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.769176    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858"} err="failed to get container status \"6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858\": rpc error: code = NotFound desc = could not find container \"6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858\": container with ID starting with 6a680d42b9d59b7f3d4e0f8345cf1108914e15909f7f743a17c25dddac54d858 not found: ID does not exist"
Sep 17 16:31:31.769230 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.769189    2582 scope.go:117] "RemoveContainer" containerID="c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568"
Sep 17 16:31:31.769451 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.769435    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568\": container with ID starting with c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568 not found: ID does not exist" containerID="c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568"
Sep 17 16:31:31.769498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.769457    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568"} err="failed to get container status \"c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568\": rpc error: code = NotFound desc = could not find container \"c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568\": container with ID starting with c13d569724798fa14d51294f9fbb9db59b626e6d89b5f93eca2a54eff49bb568 not found: ID does not exist"
Sep 17 16:31:31.769498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.769472    2582 scope.go:117] "RemoveContainer" containerID="d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1"
Sep 17 16:31:31.769745 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.769724    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1\": container with ID starting with d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1 not found: ID does not exist" containerID="d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1"
Sep 17 16:31:31.769833 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.769750    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1"} err="failed to get container status \"d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1\": rpc error: code = NotFound desc = could not find container \"d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1\": container with ID starting with d6d2b4bc95939b8c8fb83f25b2cac208ba2dfe706b5786b431c92023237388e1 not found: ID does not exist"
Sep 17 16:31:31.769833 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.769766    2582 scope.go:117] "RemoveContainer" containerID="e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"
Sep 17 16:31:31.770721 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.770679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "25e3daf9-1a13-4e33-98ac-c920ccf1bed6" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.776686 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.776670    2582 scope.go:117] "RemoveContainer" containerID="4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"
Sep 17 16:31:31.782730 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.782705    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls" (OuterVolumeSpecName: "online-tls") pod "25e3daf9-1a13-4e33-98ac-c920ccf1bed6" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.782809 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.782731    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "25e3daf9-1a13-4e33-98ac-c920ccf1bed6" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.782809 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.782770    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "25e3daf9-1a13-4e33-98ac-c920ccf1bed6" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:31:31.782809 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.782772    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-kube-api-access-6kprt" (OuterVolumeSpecName: "kube-api-access-6kprt") pod "25e3daf9-1a13-4e33-98ac-c920ccf1bed6" (UID: "25e3daf9-1a13-4e33-98ac-c920ccf1bed6"). InnerVolumeSpecName "kube-api-access-6kprt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:31:31.784016 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.784002    2582 scope.go:117] "RemoveContainer" containerID="84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"
Sep 17 16:31:31.791049 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.791031    2582 scope.go:117] "RemoveContainer" containerID="122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"
Sep 17 16:31:31.797869 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.797854    2582 scope.go:117] "RemoveContainer" containerID="dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"
Sep 17 16:31:31.804621 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.804603    2582 scope.go:117] "RemoveContainer" containerID="546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"
Sep 17 16:31:31.811481 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.811464    2582 scope.go:117] "RemoveContainer" containerID="e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"
Sep 17 16:31:31.811722 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.811704    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c\": container with ID starting with e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c not found: ID does not exist" containerID="e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"
Sep 17 16:31:31.811773 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.811731    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"} err="failed to get container status \"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c\": rpc error: code = NotFound desc = could not find container \"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c\": container with ID starting with e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c not found: ID does not exist"
Sep 17 16:31:31.811773 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.811751    2582 scope.go:117] "RemoveContainer" containerID="4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"
Sep 17 16:31:31.811980 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.811963    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579\": container with ID starting with 4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579 not found: ID does not exist" containerID="4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"
Sep 17 16:31:31.812031 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.811984    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"} err="failed to get container status \"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579\": rpc error: code = NotFound desc = could not find container \"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579\": container with ID starting with 4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579 not found: ID does not exist"
Sep 17 16:31:31.812031 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812004    2582 scope.go:117] "RemoveContainer" containerID="84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"
Sep 17 16:31:31.812203 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.812186    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f\": container with ID starting with 84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f not found: ID does not exist" containerID="84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"
Sep 17 16:31:31.812245 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812209    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"} err="failed to get container status \"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f\": rpc error: code = NotFound desc = could not find container \"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f\": container with ID starting with 84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f not found: ID does not exist"
Sep 17 16:31:31.812245 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812224    2582 scope.go:117] "RemoveContainer" containerID="122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"
Sep 17 16:31:31.812441 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.812426    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52\": container with ID starting with 122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52 not found: ID does not exist" containerID="122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"
Sep 17 16:31:31.812487 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812446    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"} err="failed to get container status \"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52\": rpc error: code = NotFound desc = could not find container \"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52\": container with ID starting with 122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52 not found: ID does not exist"
Sep 17 16:31:31.812487 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812460    2582 scope.go:117] "RemoveContainer" containerID="dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"
Sep 17 16:31:31.812712 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.812695    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634\": container with ID starting with dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634 not found: ID does not exist" containerID="dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"
Sep 17 16:31:31.812757 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812718    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"} err="failed to get container status \"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634\": rpc error: code = NotFound desc = could not find container \"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634\": container with ID starting with dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634 not found: ID does not exist"
Sep 17 16:31:31.812757 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812733    2582 scope.go:117] "RemoveContainer" containerID="546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"
Sep 17 16:31:31.812964 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:31.812946    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560\": container with ID starting with 546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560 not found: ID does not exist" containerID="546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"
Sep 17 16:31:31.813037 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812968    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"} err="failed to get container status \"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560\": rpc error: code = NotFound desc = could not find container \"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560\": container with ID starting with 546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560 not found: ID does not exist"
Sep 17 16:31:31.813037 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.812981    2582 scope.go:117] "RemoveContainer" containerID="e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"
Sep 17 16:31:31.813235 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813216    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c"} err="failed to get container status \"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c\": rpc error: code = NotFound desc = could not find container \"e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c\": container with ID starting with e904c009d31b88c080579d0ea71b3252c8e0ec0e4be0876ab1d322d3d61aff6c not found: ID does not exist"
Sep 17 16:31:31.813308 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813236    2582 scope.go:117] "RemoveContainer" containerID="4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"
Sep 17 16:31:31.813497 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813481    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579"} err="failed to get container status \"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579\": rpc error: code = NotFound desc = could not find container \"4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579\": container with ID starting with 4ef572258e971eecfd54e9f1cd58ccb983ae319a375a203c01de372e4ba27579 not found: ID does not exist"
Sep 17 16:31:31.813554 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813499    2582 scope.go:117] "RemoveContainer" containerID="84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"
Sep 17 16:31:31.813758 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813741    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f"} err="failed to get container status \"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f\": rpc error: code = NotFound desc = could not find container \"84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f\": container with ID starting with 84860e985ac97ef8e60ae104dcc3f46f103479364215292a1dbd7e41c9eee31f not found: ID does not exist"
Sep 17 16:31:31.813812 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813759    2582 scope.go:117] "RemoveContainer" containerID="122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"
Sep 17 16:31:31.813983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813967    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52"} err="failed to get container status \"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52\": rpc error: code = NotFound desc = could not find container \"122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52\": container with ID starting with 122799d2a0c10793bb382109b2d983309da4860a1793c3f1bbf57bea67d86b52 not found: ID does not exist"
Sep 17 16:31:31.814017 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.813984    2582 scope.go:117] "RemoveContainer" containerID="dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"
Sep 17 16:31:31.814203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.814186    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634"} err="failed to get container status \"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634\": rpc error: code = NotFound desc = could not find container \"dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634\": container with ID starting with dc77388c044ff5ae3fe1041623f15c831224b43740b2621e640f0fcad0491634 not found: ID does not exist"
Sep 17 16:31:31.814264 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.814205    2582 scope.go:117] "RemoveContainer" containerID="546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"
Sep 17 16:31:31.814476 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.814459    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560"} err="failed to get container status \"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560\": rpc error: code = NotFound desc = could not find container \"546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560\": container with ID starting with 546265de5d8ff0318106fbd2cc1dbb60d71cfc57f4b4974fd106bebf9c21a560 not found: ID does not exist"
Sep 17 16:31:31.852663 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.852635    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.852663 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.852659    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.852815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.852672    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.852815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.852683    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.852815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.852693    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.852815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.852704    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kprt\" (UniqueName: \"kubernetes.io/projected/25e3daf9-1a13-4e33-98ac-c920ccf1bed6-kube-api-access-6kprt\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:31:31.856016 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:31.855988    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" path="/var/lib/kubelet/pods/982c5d89-538b-4df5-83fb-13656b9617e3/volumes"
Sep 17 16:31:32.056813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:32.056778    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"]
Sep 17 16:31:32.064632 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:32.064602    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-58dbd9cc7f-gxj9k"]
Sep 17 16:31:33.855672 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:33.855626    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" path="/var/lib/kubelet/pods/25e3daf9-1a13-4e33-98ac-c920ccf1bed6/volumes"
Sep 17 16:31:44.215375 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215339    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-f8z25"]
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215621    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="offline"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215633    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="offline"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215641    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215647    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215654    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="feast-init"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="feast-init"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215667    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="offline"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215673    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="offline"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215687    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="feast-apply"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215692    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="feast-apply"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215698    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215704    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215711    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="feast-init"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215716    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="feast-init"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215721    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215726    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215731    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="registry"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215736    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="registry"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215741    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="feast-apply"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215747    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="feast-apply"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215752    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online"
Sep 17 16:31:44.215767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215757    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215794    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="online"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215804    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="ui"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215809    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="online"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215815    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="registry"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215821    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="offline"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215827    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e3daf9-1a13-4e33-98ac-c920ccf1bed6" containerName="ui"
Sep 17 16:31:44.216411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.215832    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="982c5d89-538b-4df5-83fb-13656b9617e3" containerName="offline"
Sep 17 16:31:44.220563 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.220544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.223120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.223094    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-4wvvf\""
Sep 17 16:31:44.223417 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.223381    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 16:31:44.224172 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.224156    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 17 16:31:44.224221 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.224184    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 16:31:44.230615 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.230593    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-f8z25"]
Sep 17 16:31:44.254809 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.254778    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-g7c6w"]
Sep 17 16:31:44.258125 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.258104    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:31:44.269518 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.269498    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-g7c6w"]
Sep 17 16:31:44.344419 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.344354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b9efb9df-b50e-420a-b14e-c2cb26043853-postgresdata\") pod \"postgres-864846d4f5-f8z25\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") " pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.344584 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.344437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhh9z\" (UniqueName: \"kubernetes.io/projected/b9efb9df-b50e-420a-b14e-c2cb26043853-kube-api-access-hhh9z\") pod \"postgres-864846d4f5-f8z25\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") " pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.344584 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.344463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvvj5\" (UniqueName: \"kubernetes.io/projected/485b3f1d-9169-4530-ae40-3ebc12ef7da1-kube-api-access-dvvj5\") pod \"redis-69bbd798b6-g7c6w\" (UID: \"485b3f1d-9169-4530-ae40-3ebc12ef7da1\") " pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:31:44.445362 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.445327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhh9z\" (UniqueName: \"kubernetes.io/projected/b9efb9df-b50e-420a-b14e-c2cb26043853-kube-api-access-hhh9z\") pod \"postgres-864846d4f5-f8z25\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") " pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.445362 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.445366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvvj5\" (UniqueName: \"kubernetes.io/projected/485b3f1d-9169-4530-ae40-3ebc12ef7da1-kube-api-access-dvvj5\") pod \"redis-69bbd798b6-g7c6w\" (UID: \"485b3f1d-9169-4530-ae40-3ebc12ef7da1\") " pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:31:44.445594 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.445414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b9efb9df-b50e-420a-b14e-c2cb26043853-postgresdata\") pod \"postgres-864846d4f5-f8z25\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") " pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.445725 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.445710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b9efb9df-b50e-420a-b14e-c2cb26043853-postgresdata\") pod \"postgres-864846d4f5-f8z25\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") " pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.454926 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.454894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhh9z\" (UniqueName: \"kubernetes.io/projected/b9efb9df-b50e-420a-b14e-c2cb26043853-kube-api-access-hhh9z\") pod \"postgres-864846d4f5-f8z25\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") " pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.455036 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.454896    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvvj5\" (UniqueName: \"kubernetes.io/projected/485b3f1d-9169-4530-ae40-3ebc12ef7da1-kube-api-access-dvvj5\") pod \"redis-69bbd798b6-g7c6w\" (UID: \"485b3f1d-9169-4530-ae40-3ebc12ef7da1\") " pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:31:44.538348 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.538321    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:31:44.566579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.566543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:31:44.811709 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.811683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-f8z25"]
Sep 17 16:31:44.814262 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:31:44.814237    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9efb9df_b50e_420a_b14e_c2cb26043853.slice/crio-766984023da0c9b76d8d9463f66788be0e2d359a3f8e9857c3e5253b005afadc WatchSource:0}: Error finding container 766984023da0c9b76d8d9463f66788be0e2d359a3f8e9857c3e5253b005afadc: Status 404 returned error can't find the container with id 766984023da0c9b76d8d9463f66788be0e2d359a3f8e9857c3e5253b005afadc
Sep 17 16:31:44.816102 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.816088    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:31:44.851583 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:44.851533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-g7c6w"]
Sep 17 16:31:44.853500 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:31:44.853476    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod485b3f1d_9169_4530_ae40_3ebc12ef7da1.slice/crio-96777d28f17c19f4cf1acd661ced278148e7d3a55f413930bf28eef2a28adc92 WatchSource:0}: Error finding container 96777d28f17c19f4cf1acd661ced278148e7d3a55f413930bf28eef2a28adc92: Status 404 returned error can't find the container with id 96777d28f17c19f4cf1acd661ced278148e7d3a55f413930bf28eef2a28adc92
Sep 17 16:31:45.785124 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:45.785051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-f8z25" event={"ID":"b9efb9df-b50e-420a-b14e-c2cb26043853","Type":"ContainerStarted","Data":"766984023da0c9b76d8d9463f66788be0e2d359a3f8e9857c3e5253b005afadc"}
Sep 17 16:31:45.786961 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:45.786910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-g7c6w" event={"ID":"485b3f1d-9169-4530-ae40-3ebc12ef7da1","Type":"ContainerStarted","Data":"96777d28f17c19f4cf1acd661ced278148e7d3a55f413930bf28eef2a28adc92"}
Sep 17 16:31:46.792564 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:46.792532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-g7c6w" event={"ID":"485b3f1d-9169-4530-ae40-3ebc12ef7da1","Type":"ContainerStarted","Data":"9ed2a2f43068129519bcc8466feb5593e60b5d1737e7e4e024663ab3d3f51d44"}
Sep 17 16:31:46.810715 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:46.810657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-g7c6w" podStartSLOduration=0.956563366 podStartE2EDuration="2.810636027s" totalImagesPullingTime="1.854072661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:31:46.809889821 +0000 UTC m=+765.426785645" watchObservedRunningTime="2026-09-17 16:31:46.810636027 +0000 UTC m=+765.427531850"
Sep 17 16:31:50.809403 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:50.809358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-f8z25" event={"ID":"b9efb9df-b50e-420a-b14e-c2cb26043853","Type":"ContainerStarted","Data":"2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a"}
Sep 17 16:31:50.830204 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:50.830157    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-f8z25" podStartSLOduration=1.515456247 podStartE2EDuration="6.830141359s" totalImagesPullingTime="5.314685112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:31:50.829039776 +0000 UTC m=+769.445935615" watchObservedRunningTime="2026-09-17 16:31:50.830141359 +0000 UTC m=+769.447037180"
Sep 17 16:31:55.259601 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.259570    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"]
Sep 17 16:31:55.266858 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.266828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.269678 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.269640    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 17 16:31:55.269843 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.269821    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-m6s7t\""
Sep 17 16:31:55.270052 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.270037    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 17 16:31:55.270555 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.270539    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 17 16:31:55.270651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.270614    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 17 16:31:55.278727 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.278696    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"]
Sep 17 16:31:55.332623 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.332592    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-offline-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.332623 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.332627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfwf2\" (UniqueName: \"kubernetes.io/projected/2fd733ec-d5d8-40f9-a9a9-066485279d33-kube-api-access-hfwf2\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.332829 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.332669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd733ec-d5d8-40f9-a9a9-066485279d33-feast-data\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.332829 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.332695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.332829 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.332733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-online-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.433944 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.433907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd733ec-d5d8-40f9-a9a9-066485279d33-feast-data\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.434107 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.433950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.434107 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.434069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-online-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.434228 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.434120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-offline-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.434228 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:55.434075    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Sep 17 16:31:55.434228 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.434147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfwf2\" (UniqueName: \"kubernetes.io/projected/2fd733ec-d5d8-40f9-a9a9-066485279d33-kube-api-access-hfwf2\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.434228 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:31:55.434203    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls podName:2fd733ec-d5d8-40f9-a9a9-066485279d33 nodeName:}" failed. No retries permitted until 2026-09-17 16:31:55.934177775 +0000 UTC m=+774.551073591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls") pod "feast-credit-scoring-694b9cc88b-88qv9" (UID: "2fd733ec-d5d8-40f9-a9a9-066485279d33") : secret "feast-credit-scoring-registry-tls" not found
Sep 17 16:31:55.434471 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.434318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd733ec-d5d8-40f9-a9a9-066485279d33-feast-data\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.436717 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.436695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-offline-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.436812 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.436730    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-online-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.442616 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.442594    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfwf2\" (UniqueName: \"kubernetes.io/projected/2fd733ec-d5d8-40f9-a9a9-066485279d33-kube-api-access-hfwf2\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.939273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.939238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:55.941764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:55.941733    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls\") pod \"feast-credit-scoring-694b9cc88b-88qv9\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") " pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:56.175995 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:56.175951    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:31:56.457111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:56.457082    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"]
Sep 17 16:31:56.458289 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:31:56.458261    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd733ec_d5d8_40f9_a9a9_066485279d33.slice/crio-798027cd4be609e15acb71beb61b7b645379a0ee9521952b84e11fdeca36ff9b WatchSource:0}: Error finding container 798027cd4be609e15acb71beb61b7b645379a0ee9521952b84e11fdeca36ff9b: Status 404 returned error can't find the container with id 798027cd4be609e15acb71beb61b7b645379a0ee9521952b84e11fdeca36ff9b
Sep 17 16:31:56.833916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:56.833880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerStarted","Data":"09141dc9122239183f5adfa32942322df868f4a340bca8bc41d5be5c2ba3374c"}
Sep 17 16:31:56.834118 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:56.833933    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerStarted","Data":"798027cd4be609e15acb71beb61b7b645379a0ee9521952b84e11fdeca36ff9b"}
Sep 17 16:31:58.844295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:58.844263    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerID="09141dc9122239183f5adfa32942322df868f4a340bca8bc41d5be5c2ba3374c" exitCode=0
Sep 17 16:31:58.844705 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:58.844340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerDied","Data":"09141dc9122239183f5adfa32942322df868f4a340bca8bc41d5be5c2ba3374c"}
Sep 17 16:31:59.850361 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:31:59.850329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerStarted","Data":"0c6d5297e3026bef5ab85e1f67abed7c84a394d799eabacc16b9973b7bf6f447"}
Sep 17 16:32:05.874456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:05.874339    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerID="0c6d5297e3026bef5ab85e1f67abed7c84a394d799eabacc16b9973b7bf6f447" exitCode=0
Sep 17 16:32:05.874456 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:05.874424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerDied","Data":"0c6d5297e3026bef5ab85e1f67abed7c84a394d799eabacc16b9973b7bf6f447"}
Sep 17 16:32:05.877810 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:05.877792    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 17 16:32:06.882230 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:06.882199    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerStarted","Data":"f9de81b0e64989c8e9f6f3a9dad5dbc70708dc3edd9a9011d2cf6b2bc48a5c0d"}
Sep 17 16:32:06.882739 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:06.882263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerStarted","Data":"9ca99eb10b9829b5ab935b16c95379717953dcf5760523e94187d73e2bd2d75c"}
Sep 17 16:32:06.882739 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:06.882289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerStarted","Data":"9d864b9a2f541f21686211748bb4051c4f72789673d7b4d9b8f2fcd1069a1027"}
Sep 17 16:32:06.911123 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:06.911060    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podStartSLOduration=11.911039484 podStartE2EDuration="11.911039484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:32:06.908595617 +0000 UTC m=+785.525491439" watchObservedRunningTime="2026-09-17 16:32:06.911039484 +0000 UTC m=+785.527935306"
Sep 17 16:32:08.177093 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:08.177055    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:08.177689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:08.177664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:08.177818 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:08.177701    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:08.178546 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:08.178512    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
Sep 17 16:32:08.178651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:08.178544    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Sep 17 16:32:08.178651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:08.178568    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 17 16:32:11.176751 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:11.176704    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
Sep 17 16:32:11.177273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:11.176757    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 17 16:32:11.177273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:11.176704    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Sep 17 16:32:14.176897 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.176847    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
Sep 17 16:32:14.177693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.177664    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:14.178239 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.178181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:14.179588 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.179566    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:14.274702 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.274669    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:14.924183 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.924146    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:14.927558 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:14.927524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:16.176626 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:16.176585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:17.176694 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:17.176652    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
Sep 17 16:32:20.177273 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:20.177241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:32:20.178042 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:32:20.178021    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:33:23.909274 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.909230    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"]
Sep 17 16:33:23.909836 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.909569    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry" containerID="cri-o://9d864b9a2f541f21686211748bb4051c4f72789673d7b4d9b8f2fcd1069a1027" gracePeriod=30
Sep 17 16:33:23.909836 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.909626    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online" containerID="cri-o://9ca99eb10b9829b5ab935b16c95379717953dcf5760523e94187d73e2bd2d75c" gracePeriod=30
Sep 17 16:33:23.909836 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.909645    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline" containerID="cri-o://f9de81b0e64989c8e9f6f3a9dad5dbc70708dc3edd9a9011d2cf6b2bc48a5c0d" gracePeriod=30
Sep 17 16:33:23.928423 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.928373    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-f8z25"]
Sep 17 16:33:23.928595 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.928575    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-f8z25" podUID="b9efb9df-b50e-420a-b14e-c2cb26043853" containerName="postgres" containerID="cri-o://2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a" gracePeriod=30
Sep 17 16:33:23.937267 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.937230    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-g7c6w"]
Sep 17 16:33:23.937446 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:23.937401    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-g7c6w" podUID="485b3f1d-9169-4530-ae40-3ebc12ef7da1" containerName="redis" containerID="cri-o://9ed2a2f43068129519bcc8466feb5593e60b5d1737e7e4e024663ab3d3f51d44" gracePeriod=30
Sep 17 16:33:24.170733 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.170673    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:33:24.199110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.199011    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9efb9df-b50e-420a-b14e-c2cb26043853" containerID="2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a" exitCode=0
Sep 17 16:33:24.199110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.199058    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-f8z25"
Sep 17 16:33:24.199110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.199104    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-f8z25" event={"ID":"b9efb9df-b50e-420a-b14e-c2cb26043853","Type":"ContainerDied","Data":"2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a"}
Sep 17 16:33:24.199431 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.199154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-f8z25" event={"ID":"b9efb9df-b50e-420a-b14e-c2cb26043853","Type":"ContainerDied","Data":"766984023da0c9b76d8d9463f66788be0e2d359a3f8e9857c3e5253b005afadc"}
Sep 17 16:33:24.199431 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.199178    2582 scope.go:117] "RemoveContainer" containerID="2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a"
Sep 17 16:33:24.200915 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.200891    2582 generic.go:356] "Generic (PLEG): container finished" podID="485b3f1d-9169-4530-ae40-3ebc12ef7da1" containerID="9ed2a2f43068129519bcc8466feb5593e60b5d1737e7e4e024663ab3d3f51d44" exitCode=0
Sep 17 16:33:24.201044 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.200933    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-g7c6w" event={"ID":"485b3f1d-9169-4530-ae40-3ebc12ef7da1","Type":"ContainerDied","Data":"9ed2a2f43068129519bcc8466feb5593e60b5d1737e7e4e024663ab3d3f51d44"}
Sep 17 16:33:24.211537 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.211516    2582 scope.go:117] "RemoveContainer" containerID="2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a"
Sep 17 16:33:24.211858 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:33:24.211836    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a\": container with ID starting with 2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a not found: ID does not exist" containerID="2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a"
Sep 17 16:33:24.211921 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.211873    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a"} err="failed to get container status \"2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a\": rpc error: code = NotFound desc = could not find container \"2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a\": container with ID starting with 2da7e8aefe3be58e5482bf8f11cf3366488235460c099d8f2dc0749f128bed6a not found: ID does not exist"
Sep 17 16:33:24.288608 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.288579    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:33:24.354095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.354065    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b9efb9df-b50e-420a-b14e-c2cb26043853-postgresdata\") pod \"b9efb9df-b50e-420a-b14e-c2cb26043853\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") "
Sep 17 16:33:24.354288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.354147    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhh9z\" (UniqueName: \"kubernetes.io/projected/b9efb9df-b50e-420a-b14e-c2cb26043853-kube-api-access-hhh9z\") pod \"b9efb9df-b50e-420a-b14e-c2cb26043853\" (UID: \"b9efb9df-b50e-420a-b14e-c2cb26043853\") "
Sep 17 16:33:24.356451 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.356413    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9efb9df-b50e-420a-b14e-c2cb26043853-kube-api-access-hhh9z" (OuterVolumeSpecName: "kube-api-access-hhh9z") pod "b9efb9df-b50e-420a-b14e-c2cb26043853" (UID: "b9efb9df-b50e-420a-b14e-c2cb26043853"). InnerVolumeSpecName "kube-api-access-hhh9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:33:24.383150 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.383113    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9efb9df-b50e-420a-b14e-c2cb26043853-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "b9efb9df-b50e-420a-b14e-c2cb26043853" (UID: "b9efb9df-b50e-420a-b14e-c2cb26043853"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:33:24.454987 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.454889    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvvj5\" (UniqueName: \"kubernetes.io/projected/485b3f1d-9169-4530-ae40-3ebc12ef7da1-kube-api-access-dvvj5\") pod \"485b3f1d-9169-4530-ae40-3ebc12ef7da1\" (UID: \"485b3f1d-9169-4530-ae40-3ebc12ef7da1\") "
Sep 17 16:33:24.455191 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.455172    2582 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b9efb9df-b50e-420a-b14e-c2cb26043853-postgresdata\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:24.455242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.455198    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhh9z\" (UniqueName: \"kubernetes.io/projected/b9efb9df-b50e-420a-b14e-c2cb26043853-kube-api-access-hhh9z\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:24.457069 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.457047    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485b3f1d-9169-4530-ae40-3ebc12ef7da1-kube-api-access-dvvj5" (OuterVolumeSpecName: "kube-api-access-dvvj5") pod "485b3f1d-9169-4530-ae40-3ebc12ef7da1" (UID: "485b3f1d-9169-4530-ae40-3ebc12ef7da1"). InnerVolumeSpecName "kube-api-access-dvvj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:33:24.521819 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.521782    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-f8z25"]
Sep 17 16:33:24.526233 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.526209    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-f8z25"]
Sep 17 16:33:24.555874 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.555842    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvvj5\" (UniqueName: \"kubernetes.io/projected/485b3f1d-9169-4530-ae40-3ebc12ef7da1-kube-api-access-dvvj5\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:24.925213 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:24.925168    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 17 16:33:25.207449 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.207414    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerID="9ca99eb10b9829b5ab935b16c95379717953dcf5760523e94187d73e2bd2d75c" exitCode=0
Sep 17 16:33:25.207636 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.207486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerDied","Data":"9ca99eb10b9829b5ab935b16c95379717953dcf5760523e94187d73e2bd2d75c"}
Sep 17 16:33:25.209360 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.209338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-g7c6w" event={"ID":"485b3f1d-9169-4530-ae40-3ebc12ef7da1","Type":"ContainerDied","Data":"96777d28f17c19f4cf1acd661ced278148e7d3a55f413930bf28eef2a28adc92"}
Sep 17 16:33:25.209484 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.209363    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-g7c6w"
Sep 17 16:33:25.209484 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.209378    2582 scope.go:117] "RemoveContainer" containerID="9ed2a2f43068129519bcc8466feb5593e60b5d1737e7e4e024663ab3d3f51d44"
Sep 17 16:33:25.230663 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.230640    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-g7c6w"]
Sep 17 16:33:25.237223 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.237205    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-g7c6w"]
Sep 17 16:33:25.856891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.856856    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485b3f1d-9169-4530-ae40-3ebc12ef7da1" path="/var/lib/kubelet/pods/485b3f1d-9169-4530-ae40-3ebc12ef7da1/volumes"
Sep 17 16:33:25.857203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:25.857191    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9efb9df-b50e-420a-b14e-c2cb26043853" path="/var/lib/kubelet/pods/b9efb9df-b50e-420a-b14e-c2cb26043853/volumes"
Sep 17 16:33:34.925132 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:34.925082    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 17 16:33:44.924589 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:44.924547    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Sep 17 16:33:44.924950 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:44.924662    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:33:54.178782 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.178688    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Sep 17 16:33:54.316917 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.316886    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerID="f9de81b0e64989c8e9f6f3a9dad5dbc70708dc3edd9a9011d2cf6b2bc48a5c0d" exitCode=137
Sep 17 16:33:54.316917 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.316912    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerID="9d864b9a2f541f21686211748bb4051c4f72789673d7b4d9b8f2fcd1069a1027" exitCode=137
Sep 17 16:33:54.317134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.316943    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerDied","Data":"f9de81b0e64989c8e9f6f3a9dad5dbc70708dc3edd9a9011d2cf6b2bc48a5c0d"}
Sep 17 16:33:54.317134 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.316992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerDied","Data":"9d864b9a2f541f21686211748bb4051c4f72789673d7b4d9b8f2fcd1069a1027"}
Sep 17 16:33:54.562764 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.562742    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:33:54.574044 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.574023    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-offline-tls\") pod \"2fd733ec-d5d8-40f9-a9a9-066485279d33\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") "
Sep 17 16:33:54.574117 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.574055    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-online-tls\") pod \"2fd733ec-d5d8-40f9-a9a9-066485279d33\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") "
Sep 17 16:33:54.574155 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.574115    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls\") pod \"2fd733ec-d5d8-40f9-a9a9-066485279d33\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") "
Sep 17 16:33:54.574185 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.574168    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfwf2\" (UniqueName: \"kubernetes.io/projected/2fd733ec-d5d8-40f9-a9a9-066485279d33-kube-api-access-hfwf2\") pod \"2fd733ec-d5d8-40f9-a9a9-066485279d33\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") "
Sep 17 16:33:54.574220 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.574194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd733ec-d5d8-40f9-a9a9-066485279d33-feast-data\") pod \"2fd733ec-d5d8-40f9-a9a9-066485279d33\" (UID: \"2fd733ec-d5d8-40f9-a9a9-066485279d33\") "
Sep 17 16:33:54.576215 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.576193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2fd733ec-d5d8-40f9-a9a9-066485279d33" (UID: "2fd733ec-d5d8-40f9-a9a9-066485279d33"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:33:54.576310 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.576216    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2fd733ec-d5d8-40f9-a9a9-066485279d33" (UID: "2fd733ec-d5d8-40f9-a9a9-066485279d33"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:33:54.576749 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.576728    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd733ec-d5d8-40f9-a9a9-066485279d33-kube-api-access-hfwf2" (OuterVolumeSpecName: "kube-api-access-hfwf2") pod "2fd733ec-d5d8-40f9-a9a9-066485279d33" (UID: "2fd733ec-d5d8-40f9-a9a9-066485279d33"). InnerVolumeSpecName "kube-api-access-hfwf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:33:54.576799 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.576756    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-online-tls" (OuterVolumeSpecName: "online-tls") pod "2fd733ec-d5d8-40f9-a9a9-066485279d33" (UID: "2fd733ec-d5d8-40f9-a9a9-066485279d33"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:33:54.581741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.581717    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd733ec-d5d8-40f9-a9a9-066485279d33-feast-data" (OuterVolumeSpecName: "feast-data") pod "2fd733ec-d5d8-40f9-a9a9-066485279d33" (UID: "2fd733ec-d5d8-40f9-a9a9-066485279d33"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:33:54.675676 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.675635    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:54.675676 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.675671    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:54.675676 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.675681    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2fd733ec-d5d8-40f9-a9a9-066485279d33-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:54.675676 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.675689    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfwf2\" (UniqueName: \"kubernetes.io/projected/2fd733ec-d5d8-40f9-a9a9-066485279d33-kube-api-access-hfwf2\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:54.675942 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:54.675699    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2fd733ec-d5d8-40f9-a9a9-066485279d33-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:33:55.323031 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.322997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9" event={"ID":"2fd733ec-d5d8-40f9-a9a9-066485279d33","Type":"ContainerDied","Data":"798027cd4be609e15acb71beb61b7b645379a0ee9521952b84e11fdeca36ff9b"}
Sep 17 16:33:55.323490 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.323060    2582 scope.go:117] "RemoveContainer" containerID="f9de81b0e64989c8e9f6f3a9dad5dbc70708dc3edd9a9011d2cf6b2bc48a5c0d"
Sep 17 16:33:55.323490 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.323011    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"
Sep 17 16:33:55.332194 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.332180    2582 scope.go:117] "RemoveContainer" containerID="9ca99eb10b9829b5ab935b16c95379717953dcf5760523e94187d73e2bd2d75c"
Sep 17 16:33:55.339734 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.339719    2582 scope.go:117] "RemoveContainer" containerID="9d864b9a2f541f21686211748bb4051c4f72789673d7b4d9b8f2fcd1069a1027"
Sep 17 16:33:55.346791 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.346768    2582 scope.go:117] "RemoveContainer" containerID="0c6d5297e3026bef5ab85e1f67abed7c84a394d799eabacc16b9973b7bf6f447"
Sep 17 16:33:55.347826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.347804    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"]
Sep 17 16:33:55.352084 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.352068    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-694b9cc88b-88qv9"]
Sep 17 16:33:55.354383 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.354362    2582 scope.go:117] "RemoveContainer" containerID="09141dc9122239183f5adfa32942322df868f4a340bca8bc41d5be5c2ba3374c"
Sep 17 16:33:55.860407 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:33:55.860345    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" path="/var/lib/kubelet/pods/2fd733ec-d5d8-40f9-a9a9-066485279d33/volumes"
Sep 17 16:34:01.772102 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:34:01.772072    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:34:01.774948 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:34:01.774928    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:35:58.466212 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466181    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-t5dt4"]
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466473    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466485    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466494    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="feast-apply"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466500    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="feast-apply"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466514    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466520    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466531    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="feast-init"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466537    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="feast-init"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466542    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466547    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466553    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485b3f1d-9169-4530-ae40-3ebc12ef7da1" containerName="redis"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466558    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="485b3f1d-9169-4530-ae40-3ebc12ef7da1" containerName="redis"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466564    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9efb9df-b50e-420a-b14e-c2cb26043853" containerName="postgres"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466569    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9efb9df-b50e-420a-b14e-c2cb26043853" containerName="postgres"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466609    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="online"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466615    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="registry"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466621    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9efb9df-b50e-420a-b14e-c2cb26043853" containerName="postgres"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466626    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd733ec-d5d8-40f9-a9a9-066485279d33" containerName="offline"
Sep 17 16:35:58.468579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.466633    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="485b3f1d-9169-4530-ae40-3ebc12ef7da1" containerName="redis"
Sep 17 16:35:58.469448 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.469434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:35:58.472151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.472130    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 17 16:35:58.472345 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.472333    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-tz4qn\""
Sep 17 16:35:58.473560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.473534    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 17 16:35:58.486045 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.486020    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-t5dt4"]
Sep 17 16:35:58.621787 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.621746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mxh\" (UniqueName: \"kubernetes.io/projected/594b7f9f-fc0c-45f6-8666-7a5bd32573a7-kube-api-access-p7mxh\") pod \"redis-69bbd798b6-t5dt4\" (UID: \"594b7f9f-fc0c-45f6-8666-7a5bd32573a7\") " pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:35:58.723167 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.723075    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mxh\" (UniqueName: \"kubernetes.io/projected/594b7f9f-fc0c-45f6-8666-7a5bd32573a7-kube-api-access-p7mxh\") pod \"redis-69bbd798b6-t5dt4\" (UID: \"594b7f9f-fc0c-45f6-8666-7a5bd32573a7\") " pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:35:58.733975 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.733946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mxh\" (UniqueName: \"kubernetes.io/projected/594b7f9f-fc0c-45f6-8666-7a5bd32573a7-kube-api-access-p7mxh\") pod \"redis-69bbd798b6-t5dt4\" (UID: \"594b7f9f-fc0c-45f6-8666-7a5bd32573a7\") " pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:35:58.799116 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:58.799065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:35:59.073425 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:59.073337    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-t5dt4"]
Sep 17 16:35:59.076138 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:35:59.076109    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod594b7f9f_fc0c_45f6_8666_7a5bd32573a7.slice/crio-46a3544144a077620e28de3bf1bd9d65cc74d53cd8dd4b1709610d5bc5201cf9 WatchSource:0}: Error finding container 46a3544144a077620e28de3bf1bd9d65cc74d53cd8dd4b1709610d5bc5201cf9: Status 404 returned error can't find the container with id 46a3544144a077620e28de3bf1bd9d65cc74d53cd8dd4b1709610d5bc5201cf9
Sep 17 16:35:59.761174 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:59.761135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4" event={"ID":"594b7f9f-fc0c-45f6-8666-7a5bd32573a7","Type":"ContainerStarted","Data":"75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a"}
Sep 17 16:35:59.761174 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:59.761180    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4" event={"ID":"594b7f9f-fc0c-45f6-8666-7a5bd32573a7","Type":"ContainerStarted","Data":"46a3544144a077620e28de3bf1bd9d65cc74d53cd8dd4b1709610d5bc5201cf9"}
Sep 17 16:35:59.782598 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:35:59.782544    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4" podStartSLOduration=1.782528138 podStartE2EDuration="1.782528138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:35:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:35:59.78215457 +0000 UTC m=+1018.399050394" watchObservedRunningTime="2026-09-17 16:35:59.782528138 +0000 UTC m=+1018.399423959"
Sep 17 16:36:03.914344 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:03.914314    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zndpt"]
Sep 17 16:36:03.917409 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:03.917380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:03.920261 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:03.920231    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 17 16:36:03.931400 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:03.931361    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zndpt"]
Sep 17 16:36:04.065692 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.065644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/12907527-a0c0-498e-8f7c-7a97c8e07ee8-postgresdata\") pod \"postgres-864846d4f5-zndpt\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") " pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.065692 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.065700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j28v\" (UniqueName: \"kubernetes.io/projected/12907527-a0c0-498e-8f7c-7a97c8e07ee8-kube-api-access-6j28v\") pod \"postgres-864846d4f5-zndpt\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") " pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.166704 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.166613    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/12907527-a0c0-498e-8f7c-7a97c8e07ee8-postgresdata\") pod \"postgres-864846d4f5-zndpt\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") " pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.166704 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.166664    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j28v\" (UniqueName: \"kubernetes.io/projected/12907527-a0c0-498e-8f7c-7a97c8e07ee8-kube-api-access-6j28v\") pod \"postgres-864846d4f5-zndpt\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") " pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.167069 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.167050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/12907527-a0c0-498e-8f7c-7a97c8e07ee8-postgresdata\") pod \"postgres-864846d4f5-zndpt\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") " pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.177044 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.177021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j28v\" (UniqueName: \"kubernetes.io/projected/12907527-a0c0-498e-8f7c-7a97c8e07ee8-kube-api-access-6j28v\") pod \"postgres-864846d4f5-zndpt\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") " pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.226910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.226879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:36:04.520324 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.520275    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zndpt"]
Sep 17 16:36:04.522767 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:36:04.522734    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12907527_a0c0_498e_8f7c_7a97c8e07ee8.slice/crio-919671bf20e53c89ca71d31cf333a3a3fc8dd0d5dfa959d4e11073d1f1cdbb73 WatchSource:0}: Error finding container 919671bf20e53c89ca71d31cf333a3a3fc8dd0d5dfa959d4e11073d1f1cdbb73: Status 404 returned error can't find the container with id 919671bf20e53c89ca71d31cf333a3a3fc8dd0d5dfa959d4e11073d1f1cdbb73
Sep 17 16:36:04.780476 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.780437    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt" event={"ID":"12907527-a0c0-498e-8f7c-7a97c8e07ee8","Type":"ContainerStarted","Data":"4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a"}
Sep 17 16:36:04.780643 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.780492    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt" event={"ID":"12907527-a0c0-498e-8f7c-7a97c8e07ee8","Type":"ContainerStarted","Data":"919671bf20e53c89ca71d31cf333a3a3fc8dd0d5dfa959d4e11073d1f1cdbb73"}
Sep 17 16:36:04.798710 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:04.798654    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt" podStartSLOduration=1.7986382079999998 podStartE2EDuration="1.798638208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:36:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:36:04.798096278 +0000 UTC m=+1023.414992100" watchObservedRunningTime="2026-09-17 16:36:04.798638208 +0000 UTC m=+1023.415534030"
Sep 17 16:36:09.548884 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.548848    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"]
Sep 17 16:36:09.552767 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.552747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.555357 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.555334    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 17 16:36:09.555526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.555501    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 17 16:36:09.555623 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.555562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 17 16:36:09.555683 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.555515    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-99fg6\""
Sep 17 16:36:09.574845 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.574815    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"]
Sep 17 16:36:09.710077 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.710048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkqzd\" (UniqueName: \"kubernetes.io/projected/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-kube-api-access-lkqzd\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.710266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.710109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-registry-tls\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.710266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.710133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-online-tls\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.710266 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.710178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-feast-data\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.811520 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.811438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-feast-data\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.811520 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.811495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkqzd\" (UniqueName: \"kubernetes.io/projected/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-kube-api-access-lkqzd\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.811731 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.811529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-registry-tls\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.811731 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.811544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-online-tls\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.811893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.811870    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-feast-data\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.813991 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.813973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-online-tls\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.814080 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.814065    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-registry-tls\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.824040 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.824018    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkqzd\" (UniqueName: \"kubernetes.io/projected/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-kube-api-access-lkqzd\") pod \"feast-credit-scoring-7d4fbd878f-7ldvk\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") " pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:09.864881 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:09.864850    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:10.149430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:10.146591    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"]
Sep 17 16:36:10.802924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:10.802889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerStarted","Data":"53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34"}
Sep 17 16:36:10.803300 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:10.802940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerStarted","Data":"7f9a404409a3319bee84d191ca065e99e22da5bd2e589dae904e25181e00c488"}
Sep 17 16:36:11.807799 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:11.807767    2582 generic.go:356] "Generic (PLEG): container finished" podID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerID="53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34" exitCode=0
Sep 17 16:36:11.808144 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:11.807817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerDied","Data":"53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34"}
Sep 17 16:36:12.813863 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:12.813807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerStarted","Data":"ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc"}
Sep 17 16:36:18.838226 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:18.838194    2582 generic.go:356] "Generic (PLEG): container finished" podID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerID="ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc" exitCode=0
Sep 17 16:36:18.838606 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:18.838236    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerDied","Data":"ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc"}
Sep 17 16:36:19.845906 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:19.845869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerStarted","Data":"4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e"}
Sep 17 16:36:19.846286 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:19.845927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerStarted","Data":"27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d"}
Sep 17 16:36:19.865815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:19.865787    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:19.865983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:19.865847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:19.873486 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:19.873423    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podStartSLOduration=10.873382247 podStartE2EDuration="10.873382247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:36:19.871759445 +0000 UTC m=+1038.488655270" watchObservedRunningTime="2026-09-17 16:36:19.873382247 +0000 UTC m=+1038.490278071"
Sep 17 16:36:21.865268 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:21.865236    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:21.865696 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:21.865300    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:21.866968 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:21.866934    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 17 16:36:21.867108 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:21.866934    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused"
Sep 17 16:36:24.865364 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:24.865308    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 17 16:36:24.866986 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:24.866948    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused"
Sep 17 16:36:27.865322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:27.865276    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.27:6571: connect: connection refused"
Sep 17 16:36:27.873529 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:27.873502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:27.877932 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:27.877906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:30.865920 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:30.865885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:30.866711 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:30.866687    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:36:35.348627 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.348584    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"]
Sep 17 16:36:35.352436 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.352416    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.355766 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.355744    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 17 16:36:35.356001 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.355956    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 17 16:36:35.356074 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.356045    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-6cxb6\""
Sep 17 16:36:35.356170 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.356151    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 17 16:36:35.362869 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.362844    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"]
Sep 17 16:36:35.415777 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.415739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjtsc\" (UniqueName: \"kubernetes.io/projected/39900170-c6ba-4a87-a4c1-3bf5689dc230-kube-api-access-fjtsc\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.415949 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.415811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/39900170-c6ba-4a87-a4c1-3bf5689dc230-feast-data\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.415949 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.415883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-registry-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.415949 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.415914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.516509 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.516474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/39900170-c6ba-4a87-a4c1-3bf5689dc230-feast-data\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.516509 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.516519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-registry-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.516787 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.516537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.516787 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.516566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjtsc\" (UniqueName: \"kubernetes.io/projected/39900170-c6ba-4a87-a4c1-3bf5689dc230-kube-api-access-fjtsc\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.516787 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:36:35.516653    2582 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
Sep 17 16:36:35.516787 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:36:35.516735    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls podName:39900170-c6ba-4a87-a4c1-3bf5689dc230 nodeName:}" failed. No retries permitted until 2026-09-17 16:36:36.016717029 +0000 UTC m=+1054.633612828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls") pod "feast-driver-ranking-c7fd6df6b-9kvr6" (UID: "39900170-c6ba-4a87-a4c1-3bf5689dc230") : secret "feast-driver-ranking-online-tls" not found
Sep 17 16:36:35.517059 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.516954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/39900170-c6ba-4a87-a4c1-3bf5689dc230-feast-data\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.519119 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.519097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-registry-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:35.526024 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:35.525997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjtsc\" (UniqueName: \"kubernetes.io/projected/39900170-c6ba-4a87-a4c1-3bf5689dc230-kube-api-access-fjtsc\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:36.021513 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:36.021408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:36.023890 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:36.023854    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls\") pod \"feast-driver-ranking-c7fd6df6b-9kvr6\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") " pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:36.263865 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:36.263821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:36.540990 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:36.540965    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"]
Sep 17 16:36:36.541781 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:36:36.541756    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39900170_c6ba_4a87_a4c1_3bf5689dc230.slice/crio-4a1b44473b1d63470221f77e045a9c17603fc479863d398f29937b8a293f84e3 WatchSource:0}: Error finding container 4a1b44473b1d63470221f77e045a9c17603fc479863d398f29937b8a293f84e3: Status 404 returned error can't find the container with id 4a1b44473b1d63470221f77e045a9c17603fc479863d398f29937b8a293f84e3
Sep 17 16:36:36.927499 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:36.927409    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerStarted","Data":"480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac"}
Sep 17 16:36:36.927499 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:36.927468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerStarted","Data":"4a1b44473b1d63470221f77e045a9c17603fc479863d398f29937b8a293f84e3"}
Sep 17 16:36:41.946916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:41.946884    2582 generic.go:356] "Generic (PLEG): container finished" podID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerID="480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac" exitCode=0
Sep 17 16:36:41.947289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:41.946957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerDied","Data":"480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac"}
Sep 17 16:36:42.952510 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:42.952475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerStarted","Data":"ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0"}
Sep 17 16:36:48.979542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:48.979501    2582 generic.go:356] "Generic (PLEG): container finished" podID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerID="ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0" exitCode=0
Sep 17 16:36:48.979878 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:48.979581    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerDied","Data":"ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0"}
Sep 17 16:36:49.986918 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:49.986880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerStarted","Data":"18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db"}
Sep 17 16:36:49.987331 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:49.986954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerStarted","Data":"e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2"}
Sep 17 16:36:50.011896 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:50.011833    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podStartSLOduration=15.011816397 podStartE2EDuration="15.011816397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:36:50.009821065 +0000 UTC m=+1068.626716899" watchObservedRunningTime="2026-09-17 16:36:50.011816397 +0000 UTC m=+1068.628712219"
Sep 17 16:36:51.264839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:51.264799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:51.265209 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:51.264872    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:51.266712 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:51.266678    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Sep 17 16:36:51.266712 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:51.266694    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 17 16:36:54.264437 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:54.264308    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Sep 17 16:36:54.264437 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:54.264308    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 17 16:36:56.264890 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:56.264851    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:56.265376 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:56.264918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:57.264560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:57.264510    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Sep 17 16:36:57.271111 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:57.271081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:36:57.274654 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:36:57.274626    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:37:00.264531 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:37:00.264476    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Sep 17 16:37:03.265339 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:37:03.265301    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:37:03.266098 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:37:03.266080    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:38:24.280507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.280436    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"]
Sep 17 16:38:24.280986 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.280639    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w" podUID="fe3d92ba-4b92-4505-b545-41bae05bfedd" containerName="manager" containerID="cri-o://a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6" gracePeriod=10
Sep 17 16:38:24.539891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.539814    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:38:24.701954 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.701915    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"]
Sep 17 16:38:24.702257 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.702210    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry" containerID="cri-o://27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d" gracePeriod=30
Sep 17 16:38:24.702411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.702298    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online" containerID="cri-o://4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e" gracePeriod=30
Sep 17 16:38:24.707299 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.707277    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcvdc\" (UniqueName: \"kubernetes.io/projected/fe3d92ba-4b92-4505-b545-41bae05bfedd-kube-api-access-lcvdc\") pod \"fe3d92ba-4b92-4505-b545-41bae05bfedd\" (UID: \"fe3d92ba-4b92-4505-b545-41bae05bfedd\") "
Sep 17 16:38:24.709436 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.709416    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3d92ba-4b92-4505-b545-41bae05bfedd-kube-api-access-lcvdc" (OuterVolumeSpecName: "kube-api-access-lcvdc") pod "fe3d92ba-4b92-4505-b545-41bae05bfedd" (UID: "fe3d92ba-4b92-4505-b545-41bae05bfedd"). InnerVolumeSpecName "kube-api-access-lcvdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:38:24.715121 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.715098    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"]
Sep 17 16:38:24.715298 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.715276    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry" containerID="cri-o://e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2" gracePeriod=30
Sep 17 16:38:24.715377 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.715313    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online" containerID="cri-o://18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db" gracePeriod=30
Sep 17 16:38:24.808140 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:24.808064    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcvdc\" (UniqueName: \"kubernetes.io/projected/fe3d92ba-4b92-4505-b545-41bae05bfedd-kube-api-access-lcvdc\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:25.382428 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.382372    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe3d92ba-4b92-4505-b545-41bae05bfedd" containerID="a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6" exitCode=0
Sep 17 16:38:25.382937 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.382445    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"
Sep 17 16:38:25.382937 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.382471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w" event={"ID":"fe3d92ba-4b92-4505-b545-41bae05bfedd","Type":"ContainerDied","Data":"a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6"}
Sep 17 16:38:25.382937 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.382525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w" event={"ID":"fe3d92ba-4b92-4505-b545-41bae05bfedd","Type":"ContainerDied","Data":"168cd17baa9b42a7f8cd6d7d66d0bae68f15ea8410da5077acc04dd3985330e7"}
Sep 17 16:38:25.382937 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.382558    2582 scope.go:117] "RemoveContainer" containerID="a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6"
Sep 17 16:38:25.391124 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.391103    2582 scope.go:117] "RemoveContainer" containerID="a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6"
Sep 17 16:38:25.391488 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:25.391463    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6\": container with ID starting with a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6 not found: ID does not exist" containerID="a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6"
Sep 17 16:38:25.391577 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.391499    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6"} err="failed to get container status \"a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6\": rpc error: code = NotFound desc = could not find container \"a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6\": container with ID starting with a293f38c3fb5b2c57750fc4bd19d63d2f00af48510ce07f4e313798398f67eb6 not found: ID does not exist"
Sep 17 16:38:25.409923 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.409889    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"]
Sep 17 16:38:25.418929 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.418899    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-847bc88cb4-nz98w"]
Sep 17 16:38:25.856258 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:25.856223    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3d92ba-4b92-4505-b545-41bae05bfedd" path="/var/lib/kubelet/pods/fe3d92ba-4b92-4505-b545-41bae05bfedd/volumes"
Sep 17 16:38:26.389330 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.389300    2582 generic.go:356] "Generic (PLEG): container finished" podID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerID="4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e" exitCode=0
Sep 17 16:38:26.389817 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.389379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerDied","Data":"4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e"}
Sep 17 16:38:26.391612 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.391593    2582 generic.go:356] "Generic (PLEG): container finished" podID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerID="18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db" exitCode=0
Sep 17 16:38:26.391705 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.391626    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerDied","Data":"18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db"}
Sep 17 16:38:26.877419 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.877372    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zndpt"]
Sep 17 16:38:26.877600 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.877578    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt" podUID="12907527-a0c0-498e-8f7c-7a97c8e07ee8" containerName="postgres" containerID="cri-o://4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a" gracePeriod=30
Sep 17 16:38:26.883454 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:26.883420    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-t5dt4"]
Sep 17 16:38:27.120331 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.120307    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:38:27.125035 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.125017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j28v\" (UniqueName: \"kubernetes.io/projected/12907527-a0c0-498e-8f7c-7a97c8e07ee8-kube-api-access-6j28v\") pod \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") "
Sep 17 16:38:27.125149 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.125067    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/12907527-a0c0-498e-8f7c-7a97c8e07ee8-postgresdata\") pod \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\" (UID: \"12907527-a0c0-498e-8f7c-7a97c8e07ee8\") "
Sep 17 16:38:27.127322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.127299    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12907527-a0c0-498e-8f7c-7a97c8e07ee8-kube-api-access-6j28v" (OuterVolumeSpecName: "kube-api-access-6j28v") pod "12907527-a0c0-498e-8f7c-7a97c8e07ee8" (UID: "12907527-a0c0-498e-8f7c-7a97c8e07ee8"). InnerVolumeSpecName "kube-api-access-6j28v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:38:27.156592 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.156557    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12907527-a0c0-498e-8f7c-7a97c8e07ee8-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "12907527-a0c0-498e-8f7c-7a97c8e07ee8" (UID: "12907527-a0c0-498e-8f7c-7a97c8e07ee8"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:38:27.225887 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.225846    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j28v\" (UniqueName: \"kubernetes.io/projected/12907527-a0c0-498e-8f7c-7a97c8e07ee8-kube-api-access-6j28v\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:27.225887 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.225881    2582 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/12907527-a0c0-498e-8f7c-7a97c8e07ee8-postgresdata\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:27.271734 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.271699    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 17 16:38:27.396097 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.396004    2582 generic.go:356] "Generic (PLEG): container finished" podID="12907527-a0c0-498e-8f7c-7a97c8e07ee8" containerID="4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a" exitCode=0
Sep 17 16:38:27.396097 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.396048    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt"
Sep 17 16:38:27.396097 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.396087    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt" event={"ID":"12907527-a0c0-498e-8f7c-7a97c8e07ee8","Type":"ContainerDied","Data":"4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a"}
Sep 17 16:38:27.396619 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.396130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-zndpt" event={"ID":"12907527-a0c0-498e-8f7c-7a97c8e07ee8","Type":"ContainerDied","Data":"919671bf20e53c89ca71d31cf333a3a3fc8dd0d5dfa959d4e11073d1f1cdbb73"}
Sep 17 16:38:27.396619 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.396146    2582 scope.go:117] "RemoveContainer" containerID="4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a"
Sep 17 16:38:27.396619 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.396295    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4" podUID="594b7f9f-fc0c-45f6-8666-7a5bd32573a7" containerName="redis" containerID="cri-o://75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a" gracePeriod=30
Sep 17 16:38:27.404594 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.404578    2582 scope.go:117] "RemoveContainer" containerID="4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a"
Sep 17 16:38:27.404874 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:27.404857    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a\": container with ID starting with 4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a not found: ID does not exist" containerID="4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a"
Sep 17 16:38:27.404918 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.404885    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a"} err="failed to get container status \"4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a\": rpc error: code = NotFound desc = could not find container \"4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a\": container with ID starting with 4a532a998d61d2d5aaaf0ef8506bd3ad001044f4b026169bfce63e582f15f74a not found: ID does not exist"
Sep 17 16:38:27.436867 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.436834    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zndpt"]
Sep 17 16:38:27.443400 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.443366    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-zndpt"]
Sep 17 16:38:27.632737 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.632713    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:38:27.728491 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.728411    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7mxh\" (UniqueName: \"kubernetes.io/projected/594b7f9f-fc0c-45f6-8666-7a5bd32573a7-kube-api-access-p7mxh\") pod \"594b7f9f-fc0c-45f6-8666-7a5bd32573a7\" (UID: \"594b7f9f-fc0c-45f6-8666-7a5bd32573a7\") "
Sep 17 16:38:27.730538 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.730508    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594b7f9f-fc0c-45f6-8666-7a5bd32573a7-kube-api-access-p7mxh" (OuterVolumeSpecName: "kube-api-access-p7mxh") pod "594b7f9f-fc0c-45f6-8666-7a5bd32573a7" (UID: "594b7f9f-fc0c-45f6-8666-7a5bd32573a7"). InnerVolumeSpecName "kube-api-access-p7mxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:38:27.829135 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.829095    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7mxh\" (UniqueName: \"kubernetes.io/projected/594b7f9f-fc0c-45f6-8666-7a5bd32573a7-kube-api-access-p7mxh\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:27.856800 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.856769    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12907527-a0c0-498e-8f7c-7a97c8e07ee8" path="/var/lib/kubelet/pods/12907527-a0c0-498e-8f7c-7a97c8e07ee8/volumes"
Sep 17 16:38:27.874761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:27.874726    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 17 16:38:28.403507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.403476    2582 generic.go:356] "Generic (PLEG): container finished" podID="594b7f9f-fc0c-45f6-8666-7a5bd32573a7" containerID="75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a" exitCode=0
Sep 17 16:38:28.403951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.403509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4" event={"ID":"594b7f9f-fc0c-45f6-8666-7a5bd32573a7","Type":"ContainerDied","Data":"75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a"}
Sep 17 16:38:28.403951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.403525    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4"
Sep 17 16:38:28.403951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.403553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-t5dt4" event={"ID":"594b7f9f-fc0c-45f6-8666-7a5bd32573a7","Type":"ContainerDied","Data":"46a3544144a077620e28de3bf1bd9d65cc74d53cd8dd4b1709610d5bc5201cf9"}
Sep 17 16:38:28.403951 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.403570    2582 scope.go:117] "RemoveContainer" containerID="75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a"
Sep 17 16:38:28.411574 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.411546    2582 scope.go:117] "RemoveContainer" containerID="75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a"
Sep 17 16:38:28.411883 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:28.411860    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a\": container with ID starting with 75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a not found: ID does not exist" containerID="75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a"
Sep 17 16:38:28.411972 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.411889    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a"} err="failed to get container status \"75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a\": rpc error: code = NotFound desc = could not find container \"75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a\": container with ID starting with 75883ce681f552010b3849b3b6b2b59ba77a27f6a7e61c436d44d7d15ddb608a not found: ID does not exist"
Sep 17 16:38:28.421267 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.421244    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-t5dt4"]
Sep 17 16:38:28.426110 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:28.426090    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-t5dt4"]
Sep 17 16:38:29.856541 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:29.856510    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594b7f9f-fc0c-45f6-8666-7a5bd32573a7" path="/var/lib/kubelet/pods/594b7f9f-fc0c-45f6-8666-7a5bd32573a7/volumes"
Sep 17 16:38:37.271819 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:37.271778    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 17 16:38:37.875004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:37.874970    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 17 16:38:43.934703 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.934669    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"]
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.934964    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3d92ba-4b92-4505-b545-41bae05bfedd" containerName="manager"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.934976    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3d92ba-4b92-4505-b545-41bae05bfedd" containerName="manager"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.934989    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12907527-a0c0-498e-8f7c-7a97c8e07ee8" containerName="postgres"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.934993    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="12907527-a0c0-498e-8f7c-7a97c8e07ee8" containerName="postgres"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.935006    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594b7f9f-fc0c-45f6-8666-7a5bd32573a7" containerName="redis"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.935012    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="594b7f9f-fc0c-45f6-8666-7a5bd32573a7" containerName="redis"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.935058    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="12907527-a0c0-498e-8f7c-7a97c8e07ee8" containerName="postgres"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.935069    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3d92ba-4b92-4505-b545-41bae05bfedd" containerName="manager"
Sep 17 16:38:43.935071 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.935074    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="594b7f9f-fc0c-45f6-8666-7a5bd32573a7" containerName="redis"
Sep 17 16:38:43.939064 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.939048    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:38:43.941750 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.941730    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-fgzdt\""
Sep 17 16:38:43.941865 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.941733    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 17 16:38:43.942772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.942758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 17 16:38:43.948271 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:43.948255    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"]
Sep 17 16:38:44.052236 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:44.052195    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljmc5\" (UniqueName: \"kubernetes.io/projected/2aadc645-3726-44ed-aead-b2b878d8a866-kube-api-access-ljmc5\") pod \"feast-operator-controller-manager-689b877b4b-lshcl\" (UID: \"2aadc645-3726-44ed-aead-b2b878d8a866\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:38:44.152774 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:44.152735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljmc5\" (UniqueName: \"kubernetes.io/projected/2aadc645-3726-44ed-aead-b2b878d8a866-kube-api-access-ljmc5\") pod \"feast-operator-controller-manager-689b877b4b-lshcl\" (UID: \"2aadc645-3726-44ed-aead-b2b878d8a866\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:38:44.164296 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:44.164263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljmc5\" (UniqueName: \"kubernetes.io/projected/2aadc645-3726-44ed-aead-b2b878d8a866-kube-api-access-ljmc5\") pod \"feast-operator-controller-manager-689b877b4b-lshcl\" (UID: \"2aadc645-3726-44ed-aead-b2b878d8a866\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:38:44.248658 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:44.248575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:38:44.529616 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:44.529590    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"]
Sep 17 16:38:44.532013 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:38:44.531986    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aadc645_3726_44ed_aead_b2b878d8a866.slice/crio-fd6e9765fd390c387ebb5d047dc039bf89e8312e19d71b7854b50b7a93ddece9 WatchSource:0}: Error finding container fd6e9765fd390c387ebb5d047dc039bf89e8312e19d71b7854b50b7a93ddece9: Status 404 returned error can't find the container with id fd6e9765fd390c387ebb5d047dc039bf89e8312e19d71b7854b50b7a93ddece9
Sep 17 16:38:44.533812 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:44.533796    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:38:45.472324 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:45.472278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl" event={"ID":"2aadc645-3726-44ed-aead-b2b878d8a866","Type":"ContainerStarted","Data":"fd6e9765fd390c387ebb5d047dc039bf89e8312e19d71b7854b50b7a93ddece9"}
Sep 17 16:38:47.272676 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.272590    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 17 16:38:47.273057 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.272709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:38:47.481256 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.481224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl" event={"ID":"2aadc645-3726-44ed-aead-b2b878d8a866","Type":"ContainerStarted","Data":"475c5aee8fc950fb74d5232b923784802d7b649dc205d59e8fe92e2f3a5ba9a3"}
Sep 17 16:38:47.481439 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.481312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:38:47.502604 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.502552    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl" podStartSLOduration=2.1824146 podStartE2EDuration="4.50253525s" totalImagesPullingTime="2.32012065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:38:47.50225099 +0000 UTC m=+1186.119146826" watchObservedRunningTime="2026-09-17 16:38:47.50253525 +0000 UTC m=+1186.119431076"
Sep 17 16:38:47.875015 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.874968    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
Sep 17 16:38:47.875162 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:47.875063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:38:55.369839 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.369818    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:38:55.372171 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.372154    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:38:55.436715 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436688    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-registry-tls\") pod \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") "
Sep 17 16:38:55.436715 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436719    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-registry-tls\") pod \"39900170-c6ba-4a87-a4c1-3bf5689dc230\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") "
Sep 17 16:38:55.437046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436740    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjtsc\" (UniqueName: \"kubernetes.io/projected/39900170-c6ba-4a87-a4c1-3bf5689dc230-kube-api-access-fjtsc\") pod \"39900170-c6ba-4a87-a4c1-3bf5689dc230\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") "
Sep 17 16:38:55.437046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436777    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls\") pod \"39900170-c6ba-4a87-a4c1-3bf5689dc230\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") "
Sep 17 16:38:55.437046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436805    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkqzd\" (UniqueName: \"kubernetes.io/projected/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-kube-api-access-lkqzd\") pod \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") "
Sep 17 16:38:55.437046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436831    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-online-tls\") pod \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") "
Sep 17 16:38:55.437046 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.436856    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-feast-data\") pod \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\" (UID: \"c76f5e54-07dc-47f6-a738-e4c622c8c9ee\") "
Sep 17 16:38:55.437296 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.437144    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/39900170-c6ba-4a87-a4c1-3bf5689dc230-feast-data\") pod \"39900170-c6ba-4a87-a4c1-3bf5689dc230\" (UID: \"39900170-c6ba-4a87-a4c1-3bf5689dc230\") "
Sep 17 16:38:55.438070 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.438030    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39900170-c6ba-4a87-a4c1-3bf5689dc230-feast-data" (OuterVolumeSpecName: "feast-data") pod "39900170-c6ba-4a87-a4c1-3bf5689dc230" (UID: "39900170-c6ba-4a87-a4c1-3bf5689dc230"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:38:55.439772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.439743    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c76f5e54-07dc-47f6-a738-e4c622c8c9ee" (UID: "c76f5e54-07dc-47f6-a738-e4c622c8c9ee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:38:55.439886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.439805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-online-tls" (OuterVolumeSpecName: "online-tls") pod "c76f5e54-07dc-47f6-a738-e4c622c8c9ee" (UID: "c76f5e54-07dc-47f6-a738-e4c622c8c9ee"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:38:55.439886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.439819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls" (OuterVolumeSpecName: "online-tls") pod "39900170-c6ba-4a87-a4c1-3bf5689dc230" (UID: "39900170-c6ba-4a87-a4c1-3bf5689dc230"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:38:55.439886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.439835    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39900170-c6ba-4a87-a4c1-3bf5689dc230-kube-api-access-fjtsc" (OuterVolumeSpecName: "kube-api-access-fjtsc") pod "39900170-c6ba-4a87-a4c1-3bf5689dc230" (UID: "39900170-c6ba-4a87-a4c1-3bf5689dc230"). InnerVolumeSpecName "kube-api-access-fjtsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:38:55.439886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.439840    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "39900170-c6ba-4a87-a4c1-3bf5689dc230" (UID: "39900170-c6ba-4a87-a4c1-3bf5689dc230"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:38:55.440026 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.439988    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-kube-api-access-lkqzd" (OuterVolumeSpecName: "kube-api-access-lkqzd") pod "c76f5e54-07dc-47f6-a738-e4c622c8c9ee" (UID: "c76f5e54-07dc-47f6-a738-e4c622c8c9ee"). InnerVolumeSpecName "kube-api-access-lkqzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:38:55.450615 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.450588    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-feast-data" (OuterVolumeSpecName: "feast-data") pod "c76f5e54-07dc-47f6-a738-e4c622c8c9ee" (UID: "c76f5e54-07dc-47f6-a738-e4c622c8c9ee"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:38:55.514986 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.514905    2582 generic.go:356] "Generic (PLEG): container finished" podID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerID="27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d" exitCode=137
Sep 17 16:38:55.514986 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.514960    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"
Sep 17 16:38:55.515151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.514988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerDied","Data":"27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d"}
Sep 17 16:38:55.515151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.515052    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk" event={"ID":"c76f5e54-07dc-47f6-a738-e4c622c8c9ee","Type":"ContainerDied","Data":"7f9a404409a3319bee84d191ca065e99e22da5bd2e589dae904e25181e00c488"}
Sep 17 16:38:55.515151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.515085    2582 scope.go:117] "RemoveContainer" containerID="4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e"
Sep 17 16:38:55.517614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.517591    2582 generic.go:356] "Generic (PLEG): container finished" podID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerID="e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2" exitCode=137
Sep 17 16:38:55.517736 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.517647    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"
Sep 17 16:38:55.517736 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.517680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerDied","Data":"e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2"}
Sep 17 16:38:55.517864 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.517738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6" event={"ID":"39900170-c6ba-4a87-a4c1-3bf5689dc230","Type":"ContainerDied","Data":"4a1b44473b1d63470221f77e045a9c17603fc479863d398f29937b8a293f84e3"}
Sep 17 16:38:55.529944 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.529920    2582 scope.go:117] "RemoveContainer" containerID="27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d"
Sep 17 16:38:55.537942 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537906    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.537942 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537926    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537946    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/39900170-c6ba-4a87-a4c1-3bf5689dc230-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537957    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537968    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537981    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjtsc\" (UniqueName: \"kubernetes.io/projected/39900170-c6ba-4a87-a4c1-3bf5689dc230-kube-api-access-fjtsc\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537995    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/39900170-c6ba-4a87-a4c1-3bf5689dc230-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.538009    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkqzd\" (UniqueName: \"kubernetes.io/projected/c76f5e54-07dc-47f6-a738-e4c622c8c9ee-kube-api-access-lkqzd\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:38:55.538067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.537925    2582 scope.go:117] "RemoveContainer" containerID="ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc"
Sep 17 16:38:55.545401 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.545363    2582 scope.go:117] "RemoveContainer" containerID="53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34"
Sep 17 16:38:55.546543 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.546527    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"]
Sep 17 16:38:55.552990 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.552976    2582 scope.go:117] "RemoveContainer" containerID="4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e"
Sep 17 16:38:55.553272 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.553254    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e\": container with ID starting with 4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e not found: ID does not exist" containerID="4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e"
Sep 17 16:38:55.553316 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553281    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e"} err="failed to get container status \"4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e\": rpc error: code = NotFound desc = could not find container \"4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e\": container with ID starting with 4a37d944466b44c0d6379d2f5a91a6ff6f64fec5c13064d46ad28be8bba21d4e not found: ID does not exist"
Sep 17 16:38:55.553316 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553305    2582 scope.go:117] "RemoveContainer" containerID="27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d"
Sep 17 16:38:55.553526 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553508    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7d4fbd878f-7ldvk"]
Sep 17 16:38:55.553574 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.553559    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d\": container with ID starting with 27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d not found: ID does not exist" containerID="27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d"
Sep 17 16:38:55.553610 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553575    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d"} err="failed to get container status \"27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d\": rpc error: code = NotFound desc = could not find container \"27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d\": container with ID starting with 27e011581da07dc9ba69f32d8a180676cd52c70a372153f08d5bff7d521f9c4d not found: ID does not exist"
Sep 17 16:38:55.553610 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553587    2582 scope.go:117] "RemoveContainer" containerID="ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc"
Sep 17 16:38:55.553830 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.553812    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc\": container with ID starting with ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc not found: ID does not exist" containerID="ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc"
Sep 17 16:38:55.553875 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553837    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc"} err="failed to get container status \"ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc\": rpc error: code = NotFound desc = could not find container \"ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc\": container with ID starting with ff1a62aa89e4a53261a048b4c5bf5d9701c95d347990ba3c7175ece44df22acc not found: ID does not exist"
Sep 17 16:38:55.553875 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.553853    2582 scope.go:117] "RemoveContainer" containerID="53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34"
Sep 17 16:38:55.554088 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.554074    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34\": container with ID starting with 53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34 not found: ID does not exist" containerID="53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34"
Sep 17 16:38:55.554127 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.554089    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34"} err="failed to get container status \"53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34\": rpc error: code = NotFound desc = could not find container \"53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34\": container with ID starting with 53d548cdd8dad945618054ab4be10a531d293814ed85fd8eceddfe455a877e34 not found: ID does not exist"
Sep 17 16:38:55.554127 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.554100    2582 scope.go:117] "RemoveContainer" containerID="18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db"
Sep 17 16:38:55.561104 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.561086    2582 scope.go:117] "RemoveContainer" containerID="e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2"
Sep 17 16:38:55.565681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.565660    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"]
Sep 17 16:38:55.569549 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.569532    2582 scope.go:117] "RemoveContainer" containerID="ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0"
Sep 17 16:38:55.570092 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.570071    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-c7fd6df6b-9kvr6"]
Sep 17 16:38:55.576758 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.576734    2582 scope.go:117] "RemoveContainer" containerID="480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac"
Sep 17 16:38:55.583625 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.583609    2582 scope.go:117] "RemoveContainer" containerID="18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db"
Sep 17 16:38:55.583857 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.583841    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db\": container with ID starting with 18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db not found: ID does not exist" containerID="18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db"
Sep 17 16:38:55.583899 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.583865    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db"} err="failed to get container status \"18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db\": rpc error: code = NotFound desc = could not find container \"18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db\": container with ID starting with 18a28013b5d7b977ccb704ed3e76034cb4b0e96b9dfe44cb2a8c88573a95d9db not found: ID does not exist"
Sep 17 16:38:55.583899 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.583883    2582 scope.go:117] "RemoveContainer" containerID="e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2"
Sep 17 16:38:55.584141 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.584121    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2\": container with ID starting with e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2 not found: ID does not exist" containerID="e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2"
Sep 17 16:38:55.584200 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.584150    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2"} err="failed to get container status \"e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2\": rpc error: code = NotFound desc = could not find container \"e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2\": container with ID starting with e4cdd644c5e97a43af17728e4ef39e6640f22c6776f66817f21b369c5b6c3ca2 not found: ID does not exist"
Sep 17 16:38:55.584200 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.584173    2582 scope.go:117] "RemoveContainer" containerID="ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0"
Sep 17 16:38:55.584454 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.584438    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0\": container with ID starting with ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0 not found: ID does not exist" containerID="ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0"
Sep 17 16:38:55.584500 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.584460    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0"} err="failed to get container status \"ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0\": rpc error: code = NotFound desc = could not find container \"ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0\": container with ID starting with ec3ee02b62fa3a07a7d4d22d4a7cbb16da9c5f67f65d55998e0f2e3da8e288a0 not found: ID does not exist"
Sep 17 16:38:55.584500 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.584473    2582 scope.go:117] "RemoveContainer" containerID="480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac"
Sep 17 16:38:55.584706 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:38:55.584690    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac\": container with ID starting with 480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac not found: ID does not exist" containerID="480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac"
Sep 17 16:38:55.584755 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.584717    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac"} err="failed to get container status \"480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac\": rpc error: code = NotFound desc = could not find container \"480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac\": container with ID starting with 480e7eab10fe5ba88c093008843e5d2a0935a361982ca703b9a2c3b042480cac not found: ID does not exist"
Sep 17 16:38:55.856142 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.856108    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" path="/var/lib/kubelet/pods/39900170-c6ba-4a87-a4c1-3bf5689dc230/volumes"
Sep 17 16:38:55.856597 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:55.856583    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" path="/var/lib/kubelet/pods/c76f5e54-07dc-47f6-a738-e4c622c8c9ee/volumes"
Sep 17 16:38:58.487655 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:38:58.487623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:39:00.914515 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914477    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"]
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914858    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914873    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914886    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="feast-apply"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914895    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="feast-apply"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914908    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914917    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914928    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="feast-init"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914937    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="feast-init"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914952    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914961    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914973    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="feast-apply"
Sep 17 16:39:00.914983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914981    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="feast-apply"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.914993    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="feast-init"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915001    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="feast-init"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915015    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915023    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915079    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="registry"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915088    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c76f5e54-07dc-47f6-a738-e4c622c8c9ee" containerName="online"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915096    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="registry"
Sep 17 16:39:00.915599 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.915105    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39900170-c6ba-4a87-a4c1-3bf5689dc230" containerName="online"
Sep 17 16:39:00.921891 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.921869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:00.924458 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.924435    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 16:39:00.924772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.924755    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 16:39:00.924907 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.924886    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 16:39:00.924972 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.924938    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 16:39:00.925043 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.924836    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 16:39:00.925146 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.925131    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 16:39:00.925202 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.924766    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nfc8p\""
Sep 17 16:39:00.933497 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.933200    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"]
Sep 17 16:39:00.980723 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.980694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:00.980905 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.980732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqf5s\" (UniqueName: \"kubernetes.io/projected/44987df1-8d73-4cd8-883d-603950f54812-kube-api-access-wqf5s\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:00.980905 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.980750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:00.980905 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.980808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:00.980905 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.980859    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44987df1-8d73-4cd8-883d-603950f54812-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:00.980905 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:00.980893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.081772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.081740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.081967 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.081798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44987df1-8d73-4cd8-883d-603950f54812-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.081967 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.081904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.082086 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.081978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.082086 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.082031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqf5s\" (UniqueName: \"kubernetes.io/projected/44987df1-8d73-4cd8-883d-603950f54812-kube-api-access-wqf5s\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.082185 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:39:01.082122    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:39:01.082185 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:39:01.082183    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls podName:44987df1-8d73-4cd8-883d-603950f54812 nodeName:}" failed. No retries permitted until 2026-09-17 16:39:01.582160937 +0000 UTC m=+1200.199056737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-qqln7" (UID: "44987df1-8d73-4cd8-883d-603950f54812") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:39:01.082299 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.082201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.082299 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:39:01.082292    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 16:39:01.082424 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:39:01.082329    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls podName:44987df1-8d73-4cd8-883d-603950f54812 nodeName:}" failed. No retries permitted until 2026-09-17 16:39:01.582317318 +0000 UTC m=+1200.199213126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-qqln7" (UID: "44987df1-8d73-4cd8-883d-603950f54812") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 17 16:39:01.082509 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.082494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44987df1-8d73-4cd8-883d-603950f54812-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.084965 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.084941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.085093 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.084941    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.095124 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.095103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqf5s\" (UniqueName: \"kubernetes.io/projected/44987df1-8d73-4cd8-883d-603950f54812-kube-api-access-wqf5s\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.587138 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.587099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.587333 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.587154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.589820 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.589792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.589940 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.589792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-qqln7\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:01.796723 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.796700    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:39:01.797615 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.797592    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:39:01.847916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.847841    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nfc8p\""
Sep 17 16:39:01.855562 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:01.855545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:02.139030 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:02.139003    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"]
Sep 17 16:39:02.140705 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:39:02.140681    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44987df1_8d73_4cd8_883d_603950f54812.slice/crio-77aef692d86c4d5f221816f88672dda0b0be959dbd236ac88674a42d0d03789e WatchSource:0}: Error finding container 77aef692d86c4d5f221816f88672dda0b0be959dbd236ac88674a42d0d03789e: Status 404 returned error can't find the container with id 77aef692d86c4d5f221816f88672dda0b0be959dbd236ac88674a42d0d03789e
Sep 17 16:39:02.546815 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:02.546781    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"77aef692d86c4d5f221816f88672dda0b0be959dbd236ac88674a42d0d03789e"}
Sep 17 16:39:16.606504 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:16.606468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"}
Sep 17 16:39:20.621725 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:20.621690    2582 generic.go:356] "Generic (PLEG): container finished" podID="44987df1-8d73-4cd8-883d-603950f54812" containerID="7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89" exitCode=0
Sep 17 16:39:20.622090 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:20.621747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"}
Sep 17 16:39:21.627158 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:21.627122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"}
Sep 17 16:39:26.647602 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:26.647512    2582 generic.go:356] "Generic (PLEG): container finished" podID="44987df1-8d73-4cd8-883d-603950f54812" containerID="1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31" exitCode=0
Sep 17 16:39:26.648154 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:26.647592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"}
Sep 17 16:39:27.657295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:27.657254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"}
Sep 17 16:39:27.657804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:27.657316    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"}
Sep 17 16:39:27.657804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:27.657335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"}
Sep 17 16:39:27.657804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:27.657356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerStarted","Data":"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"}
Sep 17 16:39:27.685229 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:27.684779    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podStartSLOduration=14.123279055 podStartE2EDuration="27.684757947s" totalImagesPullingTime="13.561478892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:39:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:39:27.683099375 +0000 UTC m=+1226.299995208" watchObservedRunningTime="2026-09-17 16:39:27.684757947 +0000 UTC m=+1226.301653770"
Sep 17 16:39:28.856185 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.856144    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:28.856719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.856205    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:28.856719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.856225    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:28.856719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.856241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:28.858253 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.858220    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 17 16:39:28.858518 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.858252    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Sep 17 16:39:28.858627 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.858252    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Sep 17 16:39:28.858627 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:28.858321    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 17 16:39:31.856186 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.856147    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Sep 17 16:39:31.857080 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.856258    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 17 16:39:31.857210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.856302    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Sep 17 16:39:31.857210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.856542    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 17 16:39:31.858943 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.858918    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:31.859052 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.858967    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:31.859052 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.858986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:31.859052 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:31.859002    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:34.856064 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:34.856019    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 17 16:39:34.856952 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:34.856929    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:34.857062 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:34.857036    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:34.857573 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:34.857551    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:34.857915 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:34.857899    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:34.862157 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:34.862142    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:35.701270 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:35.701240    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:37.857248 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:37.857220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:39:38.710241 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:39:38.710215    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:40:41.229743 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.229709    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"]
Sep 17 16:40:41.230304 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.229975    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" containerID="cri-o://f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06" gracePeriod=30
Sep 17 16:40:41.230304 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.230030    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online" containerID="cri-o://43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d" gracePeriod=30
Sep 17 16:40:41.230304 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.230028    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="offline" containerID="cri-o://6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb" gracePeriod=30
Sep 17 16:40:41.230304 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.229940    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="registry" containerID="cri-o://18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8" gracePeriod=30
Sep 17 16:40:41.705250 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.705211    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"]
Sep 17 16:40:41.709735 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.709708    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.712502 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.712474    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-sm6zn\""
Sep 17 16:40:41.726566 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.726476    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"]
Sep 17 16:40:41.892695 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.892663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9979bc38-e397-4674-bd81-a9ce599dec2f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.892886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.892712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.892886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.892782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.892886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.892839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcjkm\" (UniqueName: \"kubernetes.io/projected/9979bc38-e397-4674-bd81-a9ce599dec2f-kube-api-access-kcjkm\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.892886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.892866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.893056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.892893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.993981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcjkm\" (UniqueName: \"kubernetes.io/projected/9979bc38-e397-4674-bd81-a9ce599dec2f-kube-api-access-kcjkm\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.994016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.994039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994331 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.994166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9979bc38-e397-4674-bd81-a9ce599dec2f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994331 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.994199    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994331 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:40:41.994240    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:40:41.994331 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.994256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.994331 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:40:41.994301    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls podName:9979bc38-e397-4674-bd81-a9ce599dec2f nodeName:}" failed. No retries permitted until 2026-09-17 16:40:42.494280634 +0000 UTC m=+1301.111176483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls") pod "feast-simple-feast-setup-57576b8fcf-gz22m" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:40:41.994894 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.994850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9979bc38-e397-4674-bd81-a9ce599dec2f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.996759 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.996728    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.996888 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.996775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:41.997101 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:41.997062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:42.002236 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.002211    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcjkm\" (UniqueName: \"kubernetes.io/projected/9979bc38-e397-4674-bd81-a9ce599dec2f-kube-api-access-kcjkm\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:42.496955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.496918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:42.499474 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.499455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-gz22m\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:42.621349 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.621316    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:42.898479 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.898452    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"]
Sep 17 16:40:42.899994 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:40:42.899964    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9979bc38_e397_4674_bd81_a9ce599dec2f.slice/crio-b89ce0ef0bb028b1436e64501e1a974ef2d85a4a2e02b4d03255e48f231fe7ac WatchSource:0}: Error finding container b89ce0ef0bb028b1436e64501e1a974ef2d85a4a2e02b4d03255e48f231fe7ac: Status 404 returned error can't find the container with id b89ce0ef0bb028b1436e64501e1a974ef2d85a4a2e02b4d03255e48f231fe7ac
Sep 17 16:40:42.940602 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.940571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"b89ce0ef0bb028b1436e64501e1a974ef2d85a4a2e02b4d03255e48f231fe7ac"}
Sep 17 16:40:42.944016 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.943994    2582 generic.go:356] "Generic (PLEG): container finished" podID="44987df1-8d73-4cd8-883d-603950f54812" containerID="f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06" exitCode=0
Sep 17 16:40:42.944016 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.944014    2582 generic.go:356] "Generic (PLEG): container finished" podID="44987df1-8d73-4cd8-883d-603950f54812" containerID="43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d" exitCode=0
Sep 17 16:40:42.944192 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.944065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"}
Sep 17 16:40:42.944192 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:42.944109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"}
Sep 17 16:40:43.949794 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:43.949752    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"}
Sep 17 16:40:45.698503 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:45.698461    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 17 16:40:47.966403 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:47.966358    2582 generic.go:356] "Generic (PLEG): container finished" podID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerID="900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6" exitCode=0
Sep 17 16:40:47.966772 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:47.966432    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"}
Sep 17 16:40:48.710776 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:48.710734    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 17 16:40:48.977825 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:48.977737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"}
Sep 17 16:40:54.001418 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:54.001319    2582 generic.go:356] "Generic (PLEG): container finished" podID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerID="fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3" exitCode=0
Sep 17 16:40:54.001418 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:54.001369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"}
Sep 17 16:40:55.011902 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:55.011860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"}
Sep 17 16:40:55.012372 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:55.011929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"}
Sep 17 16:40:55.012372 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:55.011952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"}
Sep 17 16:40:55.012372 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:55.011969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerStarted","Data":"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"}
Sep 17 16:40:55.039244 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:55.039188    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podStartSLOduration=14.039168859 podStartE2EDuration="14.039168859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:40:55.038034342 +0000 UTC m=+1313.654930165" watchObservedRunningTime="2026-09-17 16:40:55.039168859 +0000 UTC m=+1313.656064683"
Sep 17 16:40:55.698360 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:55.698314    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 17 16:40:57.622274 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.622233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:57.622872 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.622852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:57.623004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.622993    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:57.623346 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.623333    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:40:57.624281 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.624162    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Sep 17 16:40:57.624281 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.624183    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Sep 17 16:40:57.624281 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.624211    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
Sep 17 16:40:57.624281 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:57.624171    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Sep 17 16:40:58.711008 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:40:58.710960    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 17 16:41:00.622172 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:00.622060    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Sep 17 16:41:00.622172 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:00.622060    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
Sep 17 16:41:00.622172 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:00.622083    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Sep 17 16:41:00.622821 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:00.622682    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Sep 17 16:41:02.621448 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:02.621417    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:02.621821 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:02.621479    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:02.621821 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:02.621505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:02.621821 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:02.621522    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:03.623655 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:03.623628    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:03.624015 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:03.623748    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:03.624056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:03.624042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:03.628844 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:03.628822    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:04.065553 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:04.065524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:04.065736 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:04.065602    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:04.065736 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:04.065647    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:04.068219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:04.068198    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:41:05.698690 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:05.698647    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 17 16:41:05.699106 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:05.698795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:41:08.710035 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:08.709993    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 17 16:41:08.710537 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:08.710111    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:41:11.885334 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.885310    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:41:11.928945 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.928919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls\") pod \"44987df1-8d73-4cd8-883d-603950f54812\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") "
Sep 17 16:41:11.929089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.928962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44987df1-8d73-4cd8-883d-603950f54812-feast-data\") pod \"44987df1-8d73-4cd8-883d-603950f54812\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") "
Sep 17 16:41:11.929089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.928990    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls\") pod \"44987df1-8d73-4cd8-883d-603950f54812\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") "
Sep 17 16:41:11.929089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.929027    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-online-tls\") pod \"44987df1-8d73-4cd8-883d-603950f54812\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") "
Sep 17 16:41:11.929089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.929057    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-registry-tls\") pod \"44987df1-8d73-4cd8-883d-603950f54812\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") "
Sep 17 16:41:11.929089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.929084    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqf5s\" (UniqueName: \"kubernetes.io/projected/44987df1-8d73-4cd8-883d-603950f54812-kube-api-access-wqf5s\") pod \"44987df1-8d73-4cd8-883d-603950f54812\" (UID: \"44987df1-8d73-4cd8-883d-603950f54812\") "
Sep 17 16:41:11.930290 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.929646    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44987df1-8d73-4cd8-883d-603950f54812-feast-data" (OuterVolumeSpecName: "feast-data") pod "44987df1-8d73-4cd8-883d-603950f54812" (UID: "44987df1-8d73-4cd8-883d-603950f54812"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:41:11.931916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.931879    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "44987df1-8d73-4cd8-883d-603950f54812" (UID: "44987df1-8d73-4cd8-883d-603950f54812"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:41:11.932320 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.932272    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-online-tls" (OuterVolumeSpecName: "online-tls") pod "44987df1-8d73-4cd8-883d-603950f54812" (UID: "44987df1-8d73-4cd8-883d-603950f54812"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:41:11.932320 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.932295    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "44987df1-8d73-4cd8-883d-603950f54812" (UID: "44987df1-8d73-4cd8-883d-603950f54812"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:41:11.932614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.932588    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "44987df1-8d73-4cd8-883d-603950f54812" (UID: "44987df1-8d73-4cd8-883d-603950f54812"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:41:11.932726 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:11.932688    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44987df1-8d73-4cd8-883d-603950f54812-kube-api-access-wqf5s" (OuterVolumeSpecName: "kube-api-access-wqf5s") pod "44987df1-8d73-4cd8-883d-603950f54812" (UID: "44987df1-8d73-4cd8-883d-603950f54812"). InnerVolumeSpecName "kube-api-access-wqf5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:41:12.029866 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.029833    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:41:12.029866 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.029860    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44987df1-8d73-4cd8-883d-603950f54812-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:41:12.030095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.029873    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:41:12.030095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.029905    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:41:12.030095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.029916    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44987df1-8d73-4cd8-883d-603950f54812-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:41:12.030095 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.029928    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqf5s\" (UniqueName: \"kubernetes.io/projected/44987df1-8d73-4cd8-883d-603950f54812-kube-api-access-wqf5s\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:41:12.100091 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100058    2582 generic.go:356] "Generic (PLEG): container finished" podID="44987df1-8d73-4cd8-883d-603950f54812" containerID="6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb" exitCode=137
Sep 17 16:41:12.100091 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100082    2582 generic.go:356] "Generic (PLEG): container finished" podID="44987df1-8d73-4cd8-883d-603950f54812" containerID="18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8" exitCode=137
Sep 17 16:41:12.100461 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100125    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"
Sep 17 16:41:12.100461 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"}
Sep 17 16:41:12.100461 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"}
Sep 17 16:41:12.100461 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7" event={"ID":"44987df1-8d73-4cd8-883d-603950f54812","Type":"ContainerDied","Data":"77aef692d86c4d5f221816f88672dda0b0be959dbd236ac88674a42d0d03789e"}
Sep 17 16:41:12.100461 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.100237    2582 scope.go:117] "RemoveContainer" containerID="f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"
Sep 17 16:41:12.108647 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.108631    2582 scope.go:117] "RemoveContainer" containerID="6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"
Sep 17 16:41:12.115960 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.115944    2582 scope.go:117] "RemoveContainer" containerID="43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"
Sep 17 16:41:12.122947 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.122930    2582 scope.go:117] "RemoveContainer" containerID="18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"
Sep 17 16:41:12.125275 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.125257    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"]
Sep 17 16:41:12.130197 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.130174    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-qqln7"]
Sep 17 16:41:12.131272 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.131259    2582 scope.go:117] "RemoveContainer" containerID="1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"
Sep 17 16:41:12.139058 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.139044    2582 scope.go:117] "RemoveContainer" containerID="7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"
Sep 17 16:41:12.145892 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.145877    2582 scope.go:117] "RemoveContainer" containerID="f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"
Sep 17 16:41:12.146144 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:41:12.146125    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06\": container with ID starting with f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06 not found: ID does not exist" containerID="f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"
Sep 17 16:41:12.146203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146151    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"} err="failed to get container status \"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06\": rpc error: code = NotFound desc = could not find container \"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06\": container with ID starting with f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06 not found: ID does not exist"
Sep 17 16:41:12.146203 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146168    2582 scope.go:117] "RemoveContainer" containerID="6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"
Sep 17 16:41:12.146428 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:41:12.146410    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb\": container with ID starting with 6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb not found: ID does not exist" containerID="6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"
Sep 17 16:41:12.146498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146435    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"} err="failed to get container status \"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb\": rpc error: code = NotFound desc = could not find container \"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb\": container with ID starting with 6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb not found: ID does not exist"
Sep 17 16:41:12.146498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146449    2582 scope.go:117] "RemoveContainer" containerID="43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"
Sep 17 16:41:12.146687 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:41:12.146673    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d\": container with ID starting with 43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d not found: ID does not exist" containerID="43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"
Sep 17 16:41:12.146725 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146690    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"} err="failed to get container status \"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d\": rpc error: code = NotFound desc = could not find container \"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d\": container with ID starting with 43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d not found: ID does not exist"
Sep 17 16:41:12.146725 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146701    2582 scope.go:117] "RemoveContainer" containerID="18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"
Sep 17 16:41:12.146939 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:41:12.146923    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8\": container with ID starting with 18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8 not found: ID does not exist" containerID="18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"
Sep 17 16:41:12.146989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146942    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"} err="failed to get container status \"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8\": rpc error: code = NotFound desc = could not find container \"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8\": container with ID starting with 18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8 not found: ID does not exist"
Sep 17 16:41:12.146989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.146954    2582 scope.go:117] "RemoveContainer" containerID="1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"
Sep 17 16:41:12.147169 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:41:12.147151    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31\": container with ID starting with 1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31 not found: ID does not exist" containerID="1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"
Sep 17 16:41:12.147210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147173    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"} err="failed to get container status \"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31\": rpc error: code = NotFound desc = could not find container \"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31\": container with ID starting with 1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31 not found: ID does not exist"
Sep 17 16:41:12.147210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147187    2582 scope.go:117] "RemoveContainer" containerID="7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"
Sep 17 16:41:12.147421 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:41:12.147404    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89\": container with ID starting with 7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89 not found: ID does not exist" containerID="7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"
Sep 17 16:41:12.147476 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147424    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"} err="failed to get container status \"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89\": rpc error: code = NotFound desc = could not find container \"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89\": container with ID starting with 7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89 not found: ID does not exist"
Sep 17 16:41:12.147476 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147435    2582 scope.go:117] "RemoveContainer" containerID="f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"
Sep 17 16:41:12.147646 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147630    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06"} err="failed to get container status \"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06\": rpc error: code = NotFound desc = could not find container \"f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06\": container with ID starting with f9f8cde577925659db28d33e7767432e4f2dbd4e35a435c126e64144abd37b06 not found: ID does not exist"
Sep 17 16:41:12.147646 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147645    2582 scope.go:117] "RemoveContainer" containerID="6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"
Sep 17 16:41:12.147853 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147836    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb"} err="failed to get container status \"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb\": rpc error: code = NotFound desc = could not find container \"6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb\": container with ID starting with 6f24719eb694846202fb533b08d1de2929914fda32c49cc485159c7f756f8aeb not found: ID does not exist"
Sep 17 16:41:12.147912 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.147853    2582 scope.go:117] "RemoveContainer" containerID="43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"
Sep 17 16:41:12.148056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148040    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d"} err="failed to get container status \"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d\": rpc error: code = NotFound desc = could not find container \"43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d\": container with ID starting with 43b4852ba9cf609fbbb839716d317b978260bac5a62b15c68e3227703540026d not found: ID does not exist"
Sep 17 16:41:12.148056 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148055    2582 scope.go:117] "RemoveContainer" containerID="18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"
Sep 17 16:41:12.148274 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148258    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8"} err="failed to get container status \"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8\": rpc error: code = NotFound desc = could not find container \"18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8\": container with ID starting with 18e348662b0beecbfc6ad5bb5335803e94e30c610714969c0f654c5673077bd8 not found: ID does not exist"
Sep 17 16:41:12.148317 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148274    2582 scope.go:117] "RemoveContainer" containerID="1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"
Sep 17 16:41:12.148507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148492    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31"} err="failed to get container status \"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31\": rpc error: code = NotFound desc = could not find container \"1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31\": container with ID starting with 1aa6d262baae1851088b69bc1dac1c8429edb52bbab9d23c2885de8085014a31 not found: ID does not exist"
Sep 17 16:41:12.148507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148506    2582 scope.go:117] "RemoveContainer" containerID="7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"
Sep 17 16:41:12.148729 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:12.148712    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89"} err="failed to get container status \"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89\": rpc error: code = NotFound desc = could not find container \"7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89\": container with ID starting with 7b4e46f866d0a867e685c24e64fa750c83467eda15393fdbb93545da4010eb89 not found: ID does not exist"
Sep 17 16:41:13.859661 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:41:13.857617    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44987df1-8d73-4cd8-883d-603950f54812" path="/var/lib/kubelet/pods/44987df1-8d73-4cd8-883d-603950f54812/volumes"
Sep 17 16:42:06.634259 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634223    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"]
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634511    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="feast-init"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634522    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="feast-init"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634533    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="offline"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634538    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="offline"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634549    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="feast-apply"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634554    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="feast-apply"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634560    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634565    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634573    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634578    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634584    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="registry"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634588    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="registry"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634648    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="ui"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634657    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="offline"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634663    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="registry"
Sep 17 16:42:06.634681 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.634667    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="44987df1-8d73-4cd8-883d-603950f54812" containerName="online"
Sep 17 16:42:06.638859 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.638843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.641520 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.641492    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-78wrw\""
Sep 17 16:42:06.641659 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.641549    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 16:42:06.642306 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.642289    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 16:42:06.642358 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.642305    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 16:42:06.642447 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.642429    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 16:42:06.642513 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.642481    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 16:42:06.642513 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.642500    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 16:42:06.648698 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.648678    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"]
Sep 17 16:42:06.657155 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.657132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.657253 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.657180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/271edc4c-d313-4370-93af-86c12d51dcb3-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.657253 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.657206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/271edc4c-d313-4370-93af-86c12d51dcb3-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.657352 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.657281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.657352 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.657318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4zls\" (UniqueName: \"kubernetes.io/projected/271edc4c-d313-4370-93af-86c12d51dcb3-kube-api-access-z4zls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.657471 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.657411    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.757998 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.757953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/271edc4c-d313-4370-93af-86c12d51dcb3-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/271edc4c-d313-4370-93af-86c12d51dcb3-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4zls\" (UniqueName: \"kubernetes.io/projected/271edc4c-d313-4370-93af-86c12d51dcb3-kube-api-access-z4zls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758219 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758575 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/271edc4c-d313-4370-93af-86c12d51dcb3-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.758793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.758775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/271edc4c-d313-4370-93af-86c12d51dcb3-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.760762 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.760742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.760899 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.760875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.760949 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.760894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.766809 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.766783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4zls\" (UniqueName: \"kubernetes.io/projected/271edc4c-d313-4370-93af-86c12d51dcb3-kube-api-access-z4zls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddscd\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:06.949083 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:06.948998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:07.224405 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:07.224359    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"]
Sep 17 16:42:07.226232 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:42:07.226199    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod271edc4c_d313_4370_93af_86c12d51dcb3.slice/crio-178b32e59d1de99f0ba51c1f6923891646ec7040d575c61d1741e975f9f34872 WatchSource:0}: Error finding container 178b32e59d1de99f0ba51c1f6923891646ec7040d575c61d1741e975f9f34872: Status 404 returned error can't find the container with id 178b32e59d1de99f0ba51c1f6923891646ec7040d575c61d1741e975f9f34872
Sep 17 16:42:07.300442 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:07.300413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerStarted","Data":"97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2"}
Sep 17 16:42:07.300547 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:07.300461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerStarted","Data":"178b32e59d1de99f0ba51c1f6923891646ec7040d575c61d1741e975f9f34872"}
Sep 17 16:42:12.322325 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:12.322292    2582 generic.go:356] "Generic (PLEG): container finished" podID="271edc4c-d313-4370-93af-86c12d51dcb3" containerID="97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2" exitCode=0
Sep 17 16:42:12.322706 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:12.322371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerDied","Data":"97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2"}
Sep 17 16:42:13.328035 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:13.328000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerStarted","Data":"bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92"}
Sep 17 16:42:37.415163 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:37.415121    2582 generic.go:356] "Generic (PLEG): container finished" podID="271edc4c-d313-4370-93af-86c12d51dcb3" containerID="bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92" exitCode=0
Sep 17 16:42:37.415709 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:37.415171    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerDied","Data":"bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92"}
Sep 17 16:42:38.423258 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:38.423219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerStarted","Data":"b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405"}
Sep 17 16:42:38.423775 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:38.423280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerStarted","Data":"ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f"}
Sep 17 16:42:38.423775 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:38.423300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerStarted","Data":"ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956"}
Sep 17 16:42:38.451148 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:38.451073    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podStartSLOduration=32.451052309 podStartE2EDuration="32.451052309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:42:38.44821117 +0000 UTC m=+1417.065107003" watchObservedRunningTime="2026-09-17 16:42:38.451052309 +0000 UTC m=+1417.067948131"
Sep 17 16:42:39.949208 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:39.949168    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:39.949705 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:39.949260    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:39.949705 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:39.949280    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:39.951233 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:39.951187    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 17 16:42:39.951233 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:39.951200    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused"
Sep 17 16:42:39.951233 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:39.951218    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Sep 17 16:42:42.949614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:42.949567    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 17 16:42:42.949614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:42.949616    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Sep 17 16:42:42.950132 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:42.949574    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused"
Sep 17 16:42:45.949290 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.949236    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Sep 17 16:42:45.950218 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.950194    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:45.950375 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.950362    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:45.950846 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.950811    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:45.950959 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.950866    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:45.951164 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.951145    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:45.951340 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:45.951322    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:46.950088 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:46.950047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:49.810072 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:49.810039    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:42:50.634859 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:42:50.634813    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:43:47.954546 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:47.954503    2582 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 16:43:50.815542 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:50.815496    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 17 16:43:53.092574 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.092541    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"]
Sep 17 16:43:53.092989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.092763    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" containerID="cri-o://ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956" gracePeriod=30
Sep 17 16:43:53.092989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.092866    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="offline" containerID="cri-o://ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f" gracePeriod=30
Sep 17 16:43:53.092989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.092950    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui" containerID="cri-o://b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405" gracePeriod=30
Sep 17 16:43:53.178658 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.178621    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"]
Sep 17 16:43:53.178905 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.178863    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="registry" containerID="cri-o://73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716" gracePeriod=30
Sep 17 16:43:53.179132 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.178940    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="offline" containerID="cri-o://07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08" gracePeriod=30
Sep 17 16:43:53.179241 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.178946    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online" containerID="cri-o://b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0" gracePeriod=30
Sep 17 16:43:53.179317 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:53.178980    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui" containerID="cri-o://ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6" gracePeriod=30
Sep 17 16:43:54.066198 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.066132    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Sep 17 16:43:54.066198 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.066145    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Sep 17 16:43:54.715825 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.715789    2582 generic.go:356] "Generic (PLEG): container finished" podID="271edc4c-d313-4370-93af-86c12d51dcb3" containerID="b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405" exitCode=0
Sep 17 16:43:54.715825 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.715817    2582 generic.go:356] "Generic (PLEG): container finished" podID="271edc4c-d313-4370-93af-86c12d51dcb3" containerID="ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956" exitCode=0
Sep 17 16:43:54.716299 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.715864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerDied","Data":"b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405"}
Sep 17 16:43:54.716299 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.715909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerDied","Data":"ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956"}
Sep 17 16:43:54.718974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.718951    2582 generic.go:356] "Generic (PLEG): container finished" podID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerID="ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6" exitCode=0
Sep 17 16:43:54.718974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.718970    2582 generic.go:356] "Generic (PLEG): container finished" podID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerID="b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0" exitCode=0
Sep 17 16:43:54.719121 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.719009    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"}
Sep 17 16:43:54.719121 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:54.719034    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"}
Sep 17 16:43:55.951659 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:55.951613    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 17 16:43:59.811343 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:43:59.811300    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Sep 17 16:44:01.822876 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:01.822845    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:44:01.823930 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:01.823908    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:44:04.065565 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:04.065520    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Sep 17 16:44:04.066005 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:04.065547    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Sep 17 16:44:05.951322 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:05.951272    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 17 16:44:09.811327 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:09.811284    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Sep 17 16:44:09.811735 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:09.811441    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:44:14.065752 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:14.065621    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Sep 17 16:44:14.065752 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:14.065650    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Sep 17 16:44:14.066245 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:14.065785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:44:14.066245 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:14.065858    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:44:15.951924 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:15.951880    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 17 16:44:15.952425 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:15.952016    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:44:19.811242 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:19.811194    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Sep 17 16:44:23.745152 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.745125    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:44:23.817597 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.817574    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:44:23.835092 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835061    2582 generic.go:356] "Generic (PLEG): container finished" podID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerID="07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08" exitCode=137
Sep 17 16:44:23.835092 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835082    2582 generic.go:356] "Generic (PLEG): container finished" podID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerID="73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716" exitCode=137
Sep 17 16:44:23.835295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835114    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"
Sep 17 16:44:23.835295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"}
Sep 17 16:44:23.835295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835172    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"}
Sep 17 16:44:23.835295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835190    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m" event={"ID":"9979bc38-e397-4674-bd81-a9ce599dec2f","Type":"ContainerDied","Data":"b89ce0ef0bb028b1436e64501e1a974ef2d85a4a2e02b4d03255e48f231fe7ac"}
Sep 17 16:44:23.835295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.835223    2582 scope.go:117] "RemoveContainer" containerID="ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"
Sep 17 16:44:23.837731 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.837712    2582 generic.go:356] "Generic (PLEG): container finished" podID="271edc4c-d313-4370-93af-86c12d51dcb3" containerID="ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f" exitCode=137
Sep 17 16:44:23.837827 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.837777    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"
Sep 17 16:44:23.837874 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.837758    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerDied","Data":"ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f"}
Sep 17 16:44:23.837911 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.837874    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd" event={"ID":"271edc4c-d313-4370-93af-86c12d51dcb3","Type":"ContainerDied","Data":"178b32e59d1de99f0ba51c1f6923891646ec7040d575c61d1741e975f9f34872"}
Sep 17 16:44:23.844014 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.843995    2582 scope.go:117] "RemoveContainer" containerID="07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"
Sep 17 16:44:23.853240 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.853212    2582 scope.go:117] "RemoveContainer" containerID="b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"
Sep 17 16:44:23.861978 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.861960    2582 scope.go:117] "RemoveContainer" containerID="73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"
Sep 17 16:44:23.862079 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862063    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcjkm\" (UniqueName: \"kubernetes.io/projected/9979bc38-e397-4674-bd81-a9ce599dec2f-kube-api-access-kcjkm\") pod \"9979bc38-e397-4674-bd81-a9ce599dec2f\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") "
Sep 17 16:44:23.862150 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/271edc4c-d313-4370-93af-86c12d51dcb3-registry-tls\") pod \"271edc4c-d313-4370-93af-86c12d51dcb3\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") "
Sep 17 16:44:23.862150 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862129    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-offline-tls\") pod \"271edc4c-d313-4370-93af-86c12d51dcb3\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") "
Sep 17 16:44:23.862255 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862171    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-offline-tls\") pod \"9979bc38-e397-4674-bd81-a9ce599dec2f\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") "
Sep 17 16:44:23.862255 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862197    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-ui-tls\") pod \"271edc4c-d313-4370-93af-86c12d51dcb3\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") "
Sep 17 16:44:23.862255 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862221    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9979bc38-e397-4674-bd81-a9ce599dec2f-feast-data\") pod \"9979bc38-e397-4674-bd81-a9ce599dec2f\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") "
Sep 17 16:44:23.862430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-ui-tls\") pod \"9979bc38-e397-4674-bd81-a9ce599dec2f\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") "
Sep 17 16:44:23.862430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862314    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-online-tls\") pod \"271edc4c-d313-4370-93af-86c12d51dcb3\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") "
Sep 17 16:44:23.862430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862353    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4zls\" (UniqueName: \"kubernetes.io/projected/271edc4c-d313-4370-93af-86c12d51dcb3-kube-api-access-z4zls\") pod \"271edc4c-d313-4370-93af-86c12d51dcb3\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") "
Sep 17 16:44:23.862430 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862409    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls\") pod \"9979bc38-e397-4674-bd81-a9ce599dec2f\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") "
Sep 17 16:44:23.862636 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862435    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271edc4c-d313-4370-93af-86c12d51dcb3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "271edc4c-d313-4370-93af-86c12d51dcb3" (UID: "271edc4c-d313-4370-93af-86c12d51dcb3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:44:23.862636 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862453    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-registry-tls\") pod \"9979bc38-e397-4674-bd81-a9ce599dec2f\" (UID: \"9979bc38-e397-4674-bd81-a9ce599dec2f\") "
Sep 17 16:44:23.862636 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.862509    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/271edc4c-d313-4370-93af-86c12d51dcb3-feast-data\") pod \"271edc4c-d313-4370-93af-86c12d51dcb3\" (UID: \"271edc4c-d313-4370-93af-86c12d51dcb3\") "
Sep 17 16:44:23.863091 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.863024    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/271edc4c-d313-4370-93af-86c12d51dcb3-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.863826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.863687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271edc4c-d313-4370-93af-86c12d51dcb3-feast-data" (OuterVolumeSpecName: "feast-data") pod "271edc4c-d313-4370-93af-86c12d51dcb3" (UID: "271edc4c-d313-4370-93af-86c12d51dcb3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:44:23.864030 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.863976    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9979bc38-e397-4674-bd81-a9ce599dec2f-feast-data" (OuterVolumeSpecName: "feast-data") pod "9979bc38-e397-4674-bd81-a9ce599dec2f" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:44:23.865041 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.865007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9979bc38-e397-4674-bd81-a9ce599dec2f-kube-api-access-kcjkm" (OuterVolumeSpecName: "kube-api-access-kcjkm") pod "9979bc38-e397-4674-bd81-a9ce599dec2f" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f"). InnerVolumeSpecName "kube-api-access-kcjkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:44:23.865415 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.865368    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9979bc38-e397-4674-bd81-a9ce599dec2f" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.865870 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.865833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9979bc38-e397-4674-bd81-a9ce599dec2f" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.866089 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.866055    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "271edc4c-d313-4370-93af-86c12d51dcb3" (UID: "271edc4c-d313-4370-93af-86c12d51dcb3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.866188 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.866093    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271edc4c-d313-4370-93af-86c12d51dcb3-kube-api-access-z4zls" (OuterVolumeSpecName: "kube-api-access-z4zls") pod "271edc4c-d313-4370-93af-86c12d51dcb3" (UID: "271edc4c-d313-4370-93af-86c12d51dcb3"). InnerVolumeSpecName "kube-api-access-z4zls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:44:23.866188 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.866185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9979bc38-e397-4674-bd81-a9ce599dec2f" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.866326 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.866309    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls" (OuterVolumeSpecName: "online-tls") pod "9979bc38-e397-4674-bd81-a9ce599dec2f" (UID: "9979bc38-e397-4674-bd81-a9ce599dec2f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.866406 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.866336    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-online-tls" (OuterVolumeSpecName: "online-tls") pod "271edc4c-d313-4370-93af-86c12d51dcb3" (UID: "271edc4c-d313-4370-93af-86c12d51dcb3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.866734 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.866716    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "271edc4c-d313-4370-93af-86c12d51dcb3" (UID: "271edc4c-d313-4370-93af-86c12d51dcb3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:44:23.871615 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.871598    2582 scope.go:117] "RemoveContainer" containerID="fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"
Sep 17 16:44:23.878853 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.878836    2582 scope.go:117] "RemoveContainer" containerID="900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"
Sep 17 16:44:23.885934 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.885914    2582 scope.go:117] "RemoveContainer" containerID="ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"
Sep 17 16:44:23.886205 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.886188    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6\": container with ID starting with ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6 not found: ID does not exist" containerID="ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"
Sep 17 16:44:23.886272 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886212    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"} err="failed to get container status \"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6\": rpc error: code = NotFound desc = could not find container \"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6\": container with ID starting with ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6 not found: ID does not exist"
Sep 17 16:44:23.886272 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886229    2582 scope.go:117] "RemoveContainer" containerID="07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"
Sep 17 16:44:23.886506 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.886485    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08\": container with ID starting with 07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08 not found: ID does not exist" containerID="07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"
Sep 17 16:44:23.886560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886513    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"} err="failed to get container status \"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08\": rpc error: code = NotFound desc = could not find container \"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08\": container with ID starting with 07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08 not found: ID does not exist"
Sep 17 16:44:23.886560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886529    2582 scope.go:117] "RemoveContainer" containerID="b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"
Sep 17 16:44:23.886742 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.886726    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0\": container with ID starting with b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0 not found: ID does not exist" containerID="b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"
Sep 17 16:44:23.886785 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886744    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"} err="failed to get container status \"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0\": rpc error: code = NotFound desc = could not find container \"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0\": container with ID starting with b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0 not found: ID does not exist"
Sep 17 16:44:23.886785 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886756    2582 scope.go:117] "RemoveContainer" containerID="73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"
Sep 17 16:44:23.886991 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.886977    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716\": container with ID starting with 73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716 not found: ID does not exist" containerID="73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"
Sep 17 16:44:23.887032 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.886995    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"} err="failed to get container status \"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716\": rpc error: code = NotFound desc = could not find container \"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716\": container with ID starting with 73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716 not found: ID does not exist"
Sep 17 16:44:23.887032 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887006    2582 scope.go:117] "RemoveContainer" containerID="fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"
Sep 17 16:44:23.887260 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.887242    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3\": container with ID starting with fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3 not found: ID does not exist" containerID="fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"
Sep 17 16:44:23.887311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887264    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"} err="failed to get container status \"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3\": rpc error: code = NotFound desc = could not find container \"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3\": container with ID starting with fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3 not found: ID does not exist"
Sep 17 16:44:23.887311 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887277    2582 scope.go:117] "RemoveContainer" containerID="900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"
Sep 17 16:44:23.887523 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.887509    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6\": container with ID starting with 900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6 not found: ID does not exist" containerID="900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"
Sep 17 16:44:23.887573 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887529    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"} err="failed to get container status \"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6\": rpc error: code = NotFound desc = could not find container \"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6\": container with ID starting with 900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6 not found: ID does not exist"
Sep 17 16:44:23.887573 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887540    2582 scope.go:117] "RemoveContainer" containerID="ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"
Sep 17 16:44:23.887763 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887748    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6"} err="failed to get container status \"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6\": rpc error: code = NotFound desc = could not find container \"ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6\": container with ID starting with ed8b9808acd9666857902777c17b755f941721f3b72ba5af26181bf7aecebbc6 not found: ID does not exist"
Sep 17 16:44:23.887814 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887763    2582 scope.go:117] "RemoveContainer" containerID="07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"
Sep 17 16:44:23.887979 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887960    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08"} err="failed to get container status \"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08\": rpc error: code = NotFound desc = could not find container \"07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08\": container with ID starting with 07bd6807169c82daf743da0669d16decc81a0407df90b20fcd64f54d8b611e08 not found: ID does not exist"
Sep 17 16:44:23.888037 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.887979    2582 scope.go:117] "RemoveContainer" containerID="b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"
Sep 17 16:44:23.888176 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888157    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0"} err="failed to get container status \"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0\": rpc error: code = NotFound desc = could not find container \"b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0\": container with ID starting with b18c8c383a7d8accfd3804f29480ac773dae31731b49055bd3a8d9f5a3e603b0 not found: ID does not exist"
Sep 17 16:44:23.888225 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888176    2582 scope.go:117] "RemoveContainer" containerID="73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"
Sep 17 16:44:23.888401 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888367    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716"} err="failed to get container status \"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716\": rpc error: code = NotFound desc = could not find container \"73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716\": container with ID starting with 73e05ed2d7aa001f3576119dfb00cb75dc247e0ec1a634db7ce5b6582290f716 not found: ID does not exist"
Sep 17 16:44:23.888482 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888405    2582 scope.go:117] "RemoveContainer" containerID="fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"
Sep 17 16:44:23.888659 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888641    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3"} err="failed to get container status \"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3\": rpc error: code = NotFound desc = could not find container \"fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3\": container with ID starting with fe03ce8d6355319cdfde3bb679e51a29173893af8f9e5450c71d737d0f06a4c3 not found: ID does not exist"
Sep 17 16:44:23.888712 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888660    2582 scope.go:117] "RemoveContainer" containerID="900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"
Sep 17 16:44:23.888885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888865    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6"} err="failed to get container status \"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6\": rpc error: code = NotFound desc = could not find container \"900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6\": container with ID starting with 900656aeb5249a87aad29d17d9999a99d580dfbfc1bd61fc985d14bce076afa6 not found: ID does not exist"
Sep 17 16:44:23.888940 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.888885    2582 scope.go:117] "RemoveContainer" containerID="b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405"
Sep 17 16:44:23.895845 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.895826    2582 scope.go:117] "RemoveContainer" containerID="ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f"
Sep 17 16:44:23.903008 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.902990    2582 scope.go:117] "RemoveContainer" containerID="ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956"
Sep 17 16:44:23.909751 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.909731    2582 scope.go:117] "RemoveContainer" containerID="bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92"
Sep 17 16:44:23.916887 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.916867    2582 scope.go:117] "RemoveContainer" containerID="97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2"
Sep 17 16:44:23.923989 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.923970    2582 scope.go:117] "RemoveContainer" containerID="b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405"
Sep 17 16:44:23.924249 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.924231    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405\": container with ID starting with b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405 not found: ID does not exist" containerID="b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405"
Sep 17 16:44:23.924330 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.924261    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405"} err="failed to get container status \"b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405\": rpc error: code = NotFound desc = could not find container \"b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405\": container with ID starting with b85f6c1ce9f955e02734fe38c55679ed8a2809f2a9d28776a93efa400a6c8405 not found: ID does not exist"
Sep 17 16:44:23.924330 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.924285    2582 scope.go:117] "RemoveContainer" containerID="ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f"
Sep 17 16:44:23.924546 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.924530    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f\": container with ID starting with ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f not found: ID does not exist" containerID="ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f"
Sep 17 16:44:23.924589 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.924552    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f"} err="failed to get container status \"ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f\": rpc error: code = NotFound desc = could not find container \"ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f\": container with ID starting with ede47ee8e49bad3afd288ec68464355d8d9e7480509f82bd5beccdf673e1a97f not found: ID does not exist"
Sep 17 16:44:23.924589 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.924566    2582 scope.go:117] "RemoveContainer" containerID="ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956"
Sep 17 16:44:23.924804 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.924789    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956\": container with ID starting with ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956 not found: ID does not exist" containerID="ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956"
Sep 17 16:44:23.924855 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.924806    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956"} err="failed to get container status \"ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956\": rpc error: code = NotFound desc = could not find container \"ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956\": container with ID starting with ef5c8a2643ddd4b4e43df6ae562af3edbd0085c5f543b7bd50b636b2b9782956 not found: ID does not exist"
Sep 17 16:44:23.924855 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.924820    2582 scope.go:117] "RemoveContainer" containerID="bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92"
Sep 17 16:44:23.925033 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.925019    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92\": container with ID starting with bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92 not found: ID does not exist" containerID="bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92"
Sep 17 16:44:23.925084 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.925034    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92"} err="failed to get container status \"bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92\": rpc error: code = NotFound desc = could not find container \"bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92\": container with ID starting with bba42aedbd41e3ea625c5358461b796f079de1c3e4058ef88562f9d30746fd92 not found: ID does not exist"
Sep 17 16:44:23.925084 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.925046    2582 scope.go:117] "RemoveContainer" containerID="97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2"
Sep 17 16:44:23.925230 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:44:23.925217    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2\": container with ID starting with 97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2 not found: ID does not exist" containerID="97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2"
Sep 17 16:44:23.925269 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.925232    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2"} err="failed to get container status \"97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2\": rpc error: code = NotFound desc = could not find container \"97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2\": container with ID starting with 97c6a0070b10eb9a31f3f8606806f9f590c8be66d41251ff84630a89a5484ee2 not found: ID does not exist"
Sep 17 16:44:23.964433 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964375    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964433 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964428    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/271edc4c-d313-4370-93af-86c12d51dcb3-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964433 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964437    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcjkm\" (UniqueName: \"kubernetes.io/projected/9979bc38-e397-4674-bd81-a9ce599dec2f-kube-api-access-kcjkm\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964447    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964461    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964471    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964479    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9979bc38-e397-4674-bd81-a9ce599dec2f-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964486    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964513    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/271edc4c-d313-4370-93af-86c12d51dcb3-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964521    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4zls\" (UniqueName: \"kubernetes.io/projected/271edc4c-d313-4370-93af-86c12d51dcb3-kube-api-access-z4zls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:23.964613 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:23.964529    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9979bc38-e397-4674-bd81-a9ce599dec2f-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:24.159313 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:24.159286    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"]
Sep 17 16:44:24.164019 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:24.163992    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-gz22m"]
Sep 17 16:44:24.175862 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:24.175836    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"]
Sep 17 16:44:24.182113 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:24.182094    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddscd"]
Sep 17 16:44:25.855875 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:25.855841    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" path="/var/lib/kubelet/pods/271edc4c-d313-4370-93af-86c12d51dcb3/volumes"
Sep 17 16:44:25.856385 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:25.856370    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" path="/var/lib/kubelet/pods/9979bc38-e397-4674-bd81-a9ce599dec2f/volumes"
Sep 17 16:44:42.692712 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:42.692671    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"]
Sep 17 16:44:42.693239 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:42.692862    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl" podUID="2aadc645-3726-44ed-aead-b2b878d8a866" containerName="manager" containerID="cri-o://475c5aee8fc950fb74d5232b923784802d7b649dc205d59e8fe92e2f3a5ba9a3" gracePeriod=10
Sep 17 16:44:42.910372 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:42.910341    2582 generic.go:356] "Generic (PLEG): container finished" podID="2aadc645-3726-44ed-aead-b2b878d8a866" containerID="475c5aee8fc950fb74d5232b923784802d7b649dc205d59e8fe92e2f3a5ba9a3" exitCode=0
Sep 17 16:44:42.910579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:42.910378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl" event={"ID":"2aadc645-3726-44ed-aead-b2b878d8a866","Type":"ContainerDied","Data":"475c5aee8fc950fb74d5232b923784802d7b649dc205d59e8fe92e2f3a5ba9a3"}
Sep 17 16:44:42.936076 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:42.936042    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:44:43.009137 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.009046    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljmc5\" (UniqueName: \"kubernetes.io/projected/2aadc645-3726-44ed-aead-b2b878d8a866-kube-api-access-ljmc5\") pod \"2aadc645-3726-44ed-aead-b2b878d8a866\" (UID: \"2aadc645-3726-44ed-aead-b2b878d8a866\") "
Sep 17 16:44:43.011428 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.011366    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aadc645-3726-44ed-aead-b2b878d8a866-kube-api-access-ljmc5" (OuterVolumeSpecName: "kube-api-access-ljmc5") pod "2aadc645-3726-44ed-aead-b2b878d8a866" (UID: "2aadc645-3726-44ed-aead-b2b878d8a866"). InnerVolumeSpecName "kube-api-access-ljmc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:44:43.110583 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.110537    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljmc5\" (UniqueName: \"kubernetes.io/projected/2aadc645-3726-44ed-aead-b2b878d8a866-kube-api-access-ljmc5\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:44:43.915384 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.915342    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl" event={"ID":"2aadc645-3726-44ed-aead-b2b878d8a866","Type":"ContainerDied","Data":"fd6e9765fd390c387ebb5d047dc039bf89e8312e19d71b7854b50b7a93ddece9"}
Sep 17 16:44:43.915862 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.915414    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"
Sep 17 16:44:43.915862 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.915438    2582 scope.go:117] "RemoveContainer" containerID="475c5aee8fc950fb74d5232b923784802d7b649dc205d59e8fe92e2f3a5ba9a3"
Sep 17 16:44:43.933921 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.933890    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"]
Sep 17 16:44:43.940312 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:43.940283    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-lshcl"]
Sep 17 16:44:45.855864 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:45.855825    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aadc645-3726-44ed-aead-b2b878d8a866" path="/var/lib/kubelet/pods/2aadc645-3726-44ed-aead-b2b878d8a866/volumes"
Sep 17 16:44:47.362575 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362540    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"]
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362781    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="feast-apply"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362791    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="feast-apply"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362799    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362805    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362816    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="feast-init"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362821    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="feast-init"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362828    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aadc645-3726-44ed-aead-b2b878d8a866" containerName="manager"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362833    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aadc645-3726-44ed-aead-b2b878d8a866" containerName="manager"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362839    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362844    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362852    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="offline"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362857    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="offline"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362864    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="feast-init"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362869    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="feast-init"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362887    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362893    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362899    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="offline"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="offline"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362911    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="registry"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362917    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="registry"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362922    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362927    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362934    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="feast-apply"
Sep 17 16:44:47.362957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362939    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="feast-apply"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="offline"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362981    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="registry"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362987    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="online"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362992    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="online"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.362998    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="ui"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.363002    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aadc645-3726-44ed-aead-b2b878d8a866" containerName="manager"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.363007    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="271edc4c-d313-4370-93af-86c12d51dcb3" containerName="ui"
Sep 17 16:44:47.363689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.363012    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9979bc38-e397-4674-bd81-a9ce599dec2f" containerName="offline"
Sep 17 16:44:47.366999 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.366983    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:44:47.369629 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.369609    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 17 16:44:47.370593 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.370575    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 17 16:44:47.370661 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.370583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-fgzdt\""
Sep 17 16:44:47.374669 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.374640    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"]
Sep 17 16:44:47.444051 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.444010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pk7v\" (UniqueName: \"kubernetes.io/projected/947acb5a-d714-44e4-a2ec-f11a98033e46-kube-api-access-6pk7v\") pod \"feast-operator-controller-manager-689b877b4b-7hlcf\" (UID: \"947acb5a-d714-44e4-a2ec-f11a98033e46\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:44:47.545042 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.545004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pk7v\" (UniqueName: \"kubernetes.io/projected/947acb5a-d714-44e4-a2ec-f11a98033e46-kube-api-access-6pk7v\") pod \"feast-operator-controller-manager-689b877b4b-7hlcf\" (UID: \"947acb5a-d714-44e4-a2ec-f11a98033e46\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:44:47.556652 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.556620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pk7v\" (UniqueName: \"kubernetes.io/projected/947acb5a-d714-44e4-a2ec-f11a98033e46-kube-api-access-6pk7v\") pod \"feast-operator-controller-manager-689b877b4b-7hlcf\" (UID: \"947acb5a-d714-44e4-a2ec-f11a98033e46\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:44:47.676923 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.676824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:44:47.946817 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:47.946676    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"]
Sep 17 16:44:48.935426 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:48.935370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf" event={"ID":"947acb5a-d714-44e4-a2ec-f11a98033e46","Type":"ContainerStarted","Data":"e7282267475886abfb20f94cb834fb3bb07cef6a38d153a512d32797948afd05"}
Sep 17 16:44:48.935865 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:48.935449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf" event={"ID":"947acb5a-d714-44e4-a2ec-f11a98033e46","Type":"ContainerStarted","Data":"9d9c2dc4ef04c7b5d25d13d97b442f9fda12decfc359458ca6ac9ce1f2ef7f2f"}
Sep 17 16:44:48.935865 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:48.935564    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:44:48.956551 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:48.956499    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf" podStartSLOduration=1.956483738 podStartE2EDuration="1.956483738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:44:48.95524906 +0000 UTC m=+1547.572144882" watchObservedRunningTime="2026-09-17 16:44:48.956483738 +0000 UTC m=+1547.573379605"
Sep 17 16:44:59.941414 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:44:59.941361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-7hlcf"
Sep 17 16:45:07.108243 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.108206    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"]
Sep 17 16:45:07.113543 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.113522    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.116120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116098    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 17 16:45:07.116260 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116171    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 17 16:45:07.116427 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116384    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 17 16:45:07.116525 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116483    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 17 16:45:07.116614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116597    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 17 16:45:07.116711 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-2sskg\""
Sep 17 16:45:07.116794 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.116416    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 17 16:45:07.124804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.124771    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"]
Sep 17 16:45:07.294213 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.294172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.294404 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.294223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.294404 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.294298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/33f84cd4-4767-4375-98b0-887312e9b4a5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.294404 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.294354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzbm8\" (UniqueName: \"kubernetes.io/projected/33f84cd4-4767-4375-98b0-887312e9b4a5-kube-api-access-nzbm8\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.294404 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.294379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.294616 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.294454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395415 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395415 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395415 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395702 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/33f84cd4-4767-4375-98b0-887312e9b4a5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395702 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzbm8\" (UniqueName: \"kubernetes.io/projected/33f84cd4-4767-4375-98b0-887312e9b4a5-kube-api-access-nzbm8\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395702 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.395855 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:45:07.395766    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:45:07.395855 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:45:07.395832    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls podName:33f84cd4-4767-4375-98b0-887312e9b4a5 nodeName:}" failed. No retries permitted until 2026-09-17 16:45:07.895809009 +0000 UTC m=+1566.512704825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls") pod "feast-simple-feast-setup-57576b8fcf-7f8pd" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5") : secret "feast-simple-feast-setup-online-tls" not found
Sep 17 16:45:07.395983 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.395930    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/33f84cd4-4767-4375-98b0-887312e9b4a5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.398230 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.398205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.398411 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.398377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.398560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.398540    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.405560 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.405536    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzbm8\" (UniqueName: \"kubernetes.io/projected/33f84cd4-4767-4375-98b0-887312e9b4a5-kube-api-access-nzbm8\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.899899 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.899867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:07.902470 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:07.902452    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7f8pd\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:08.033937 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:08.033906    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:08.312136 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:08.312109    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"]
Sep 17 16:45:08.312910 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:45:08.312887    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33f84cd4_4767_4375_98b0_887312e9b4a5.slice/crio-2a5e6d1584f6785a3bf25e902e48fa7d86673e85ef53d7f0489cb4390f3d12c1 WatchSource:0}: Error finding container 2a5e6d1584f6785a3bf25e902e48fa7d86673e85ef53d7f0489cb4390f3d12c1: Status 404 returned error can't find the container with id 2a5e6d1584f6785a3bf25e902e48fa7d86673e85ef53d7f0489cb4390f3d12c1
Sep 17 16:45:09.015119 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:09.015084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"}
Sep 17 16:45:09.015292 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:09.015128    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"2a5e6d1584f6785a3bf25e902e48fa7d86673e85ef53d7f0489cb4390f3d12c1"}
Sep 17 16:45:14.036498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:14.036464    2582 generic.go:356] "Generic (PLEG): container finished" podID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerID="0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf" exitCode=0
Sep 17 16:45:14.036928 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:14.036534    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"}
Sep 17 16:45:15.042863 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:15.042826    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"}
Sep 17 16:45:20.061105 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:20.061072    2582 generic.go:356] "Generic (PLEG): container finished" podID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerID="522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f" exitCode=0
Sep 17 16:45:20.061493 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:20.061131    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"}
Sep 17 16:45:21.070429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:21.070367    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"}
Sep 17 16:45:21.070910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:21.070457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"}
Sep 17 16:45:21.070910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:21.070480    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"}
Sep 17 16:45:21.070910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:21.070499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerStarted","Data":"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"}
Sep 17 16:45:21.097939 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:21.097765    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podStartSLOduration=14.09774354 podStartE2EDuration="14.09774354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:45:21.095712106 +0000 UTC m=+1579.712607960" watchObservedRunningTime="2026-09-17 16:45:21.09774354 +0000 UTC m=+1579.714639469"
Sep 17 16:45:23.034784 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.034739    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:23.035278 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.034808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:23.035278 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.034827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:23.035278 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.034845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:23.037175 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.037132    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Sep 17 16:45:23.037175 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.037158    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Sep 17 16:45:23.037367 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.037159    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Sep 17 16:45:23.037367 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:23.037220    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Sep 17 16:45:26.034966 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:26.034801    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Sep 17 16:45:26.034966 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:26.034815    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Sep 17 16:45:26.034966 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:26.034881    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Sep 17 16:45:26.034966 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:26.034931    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Sep 17 16:45:28.034352 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:28.034300    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:28.034752 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:28.034368    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:28.034752 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:28.034383    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:28.034752 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:28.034412    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.035223 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.035189    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.035968 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.035945    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.036140 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.036127    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.036759 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.036738    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.036882 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.036795    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.037077 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.037058    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.041199 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.041183    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:45:29.112738 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:45:29.112697    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:46:30.723429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:30.723378    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"]
Sep 17 16:46:30.726813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:30.723624    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="registry" containerID="cri-o://5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb" gracePeriod=30
Sep 17 16:46:30.726813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:30.723689    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui" containerID="cri-o://944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450" gracePeriod=30
Sep 17 16:46:30.726813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:30.723723    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="offline" containerID="cri-o://965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b" gracePeriod=30
Sep 17 16:46:30.726813 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:30.723798    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online" containerID="cri-o://68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86" gracePeriod=30
Sep 17 16:46:31.168728 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.168675    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"]
Sep 17 16:46:31.173368 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.173340    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.175738 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.175711    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tf6fq\""
Sep 17 16:46:31.185162 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.185127    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"]
Sep 17 16:46:31.343509 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.343462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.343509 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.343510    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.343763 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.343573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.343763 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.343601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4nqj\" (UniqueName: \"kubernetes.io/projected/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-kube-api-access-s4nqj\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.343763 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.343626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.343763 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.343648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.444724 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.444696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.444724 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.444728    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.444943 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.444761    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.444943 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.444787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4nqj\" (UniqueName: \"kubernetes.io/projected/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-kube-api-access-s4nqj\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.445140 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.445104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.445140 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.445108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.445338 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.445168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.445418 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:46:31.445335    2582 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:46:31.445418 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:46:31.445414    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls podName:d83970a9-ebd3-44f5-a3e3-19b11a426bf6 nodeName:}" failed. No retries permitted until 2026-09-17 16:46:31.945374517 +0000 UTC m=+1650.562270320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-tkzwk" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 17 16:46:31.447853 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.447818    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.447973 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.447826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.447973 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.447864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.454277 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.454251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4nqj\" (UniqueName: \"kubernetes.io/projected/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-kube-api-access-s4nqj\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.949485 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.949448    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:31.952063 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:31.952034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tkzwk\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:32.087539 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:32.087498    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:32.343452 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:32.343420    2582 generic.go:356] "Generic (PLEG): container finished" podID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerID="944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450" exitCode=0
Sep 17 16:46:32.343452 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:32.343445    2582 generic.go:356] "Generic (PLEG): container finished" podID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerID="68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86" exitCode=0
Sep 17 16:46:32.343641 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:32.343486    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"}
Sep 17 16:46:32.343641 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:32.343525    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"}
Sep 17 16:46:32.364333 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:32.364309    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"]
Sep 17 16:46:32.365349 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:46:32.365322    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd83970a9_ebd3_44f5_a3e3_19b11a426bf6.slice/crio-f8566d2d8de56f3e245532b9ff57a9af5a60b612cf575b7812a82bb5e8385656 WatchSource:0}: Error finding container f8566d2d8de56f3e245532b9ff57a9af5a60b612cf575b7812a82bb5e8385656: Status 404 returned error can't find the container with id f8566d2d8de56f3e245532b9ff57a9af5a60b612cf575b7812a82bb5e8385656
Sep 17 16:46:33.348719 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:33.348679    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"913f0116a064979fb6349b061b284ba9fb111a5a47117efd58e45ffb2e474607"}
Sep 17 16:46:33.349104 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:33.348735    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"f8566d2d8de56f3e245532b9ff57a9af5a60b612cf575b7812a82bb5e8385656"}
Sep 17 16:46:37.365742 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:37.365705    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerID="913f0116a064979fb6349b061b284ba9fb111a5a47117efd58e45ffb2e474607" exitCode=0
Sep 17 16:46:37.365742 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:37.365741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"913f0116a064979fb6349b061b284ba9fb111a5a47117efd58e45ffb2e474607"}
Sep 17 16:46:38.371880 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:38.371843    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"7922c743f8b0b2d11fabbd88a7c650cbeccfff56a17a6fa9d7d1ef68109d2cef"}
Sep 17 16:46:39.036802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:39.036751    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Sep 17 16:46:39.110693 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:39.110647    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Sep 17 16:46:43.393770 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:43.393735    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerID="7922c743f8b0b2d11fabbd88a7c650cbeccfff56a17a6fa9d7d1ef68109d2cef" exitCode=0
Sep 17 16:46:43.394146 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:43.393806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"7922c743f8b0b2d11fabbd88a7c650cbeccfff56a17a6fa9d7d1ef68109d2cef"}
Sep 17 16:46:44.404507 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:44.404457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"cbc74ca1977dae1bb510980da2c0cda61691b7a90c193f19343bde77920bd0ed"}
Sep 17 16:46:44.405004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:44.404514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"9313b3d38c3c22752be8175b1b8b0006a533220e4fb85e850519b789cebddb4b"}
Sep 17 16:46:44.405004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:44.404536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"482bd0e6408da50c06009b9ba070eb1ad23a1a5592781581625ba07f194e431d"}
Sep 17 16:46:44.405004 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:44.404552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerStarted","Data":"4834b672776bd11645eb46bbb30edb0b562eab492d30b71f0feb6d23035d23c2"}
Sep 17 16:46:44.430697 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:44.430634    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podStartSLOduration=13.430610613 podStartE2EDuration="13.430610613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:46:44.42830412 +0000 UTC m=+1663.045199949" watchObservedRunningTime="2026-09-17 16:46:44.430610613 +0000 UTC m=+1663.047506438"
Sep 17 16:46:47.088787 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.088741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:47.089289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.088809    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:47.089289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.088830    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:47.089289 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.088847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:47.090910 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.090863    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Sep 17 16:46:47.091032 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.090903    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
Sep 17 16:46:47.091032 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.090927    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Sep 17 16:46:47.091167 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:47.091019    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Sep 17 16:46:49.037721 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:49.037595    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Sep 17 16:46:49.110737 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:49.110688    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Sep 17 16:46:50.088342 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:50.088283    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
Sep 17 16:46:50.088956 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:50.088283    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Sep 17 16:46:50.088956 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:50.088289    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Sep 17 16:46:50.088956 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:50.088291    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Sep 17 16:46:52.087827 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:52.087782    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:52.088210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:52.087847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:52.088210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:52.087867    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:52.088210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:52.087879    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.088802 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.088774    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.089246 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.089141    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.089294 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.089281    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.089572 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.089555    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.094282 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.094266    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.451651 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.451566    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:53.454414 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:53.454370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:54.455555 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:54.455528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:46:59.037148 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:59.037108    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Sep 17 16:46:59.037624 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:59.037254    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:46:59.109699 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:59.109654    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Sep 17 16:46:59.109888 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:46:59.109823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:47:01.370867 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.370842    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:47:01.377454 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.377435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-offline-tls\") pod \"33f84cd4-4767-4375-98b0-887312e9b4a5\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") "
Sep 17 16:47:01.377535 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.377478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/33f84cd4-4767-4375-98b0-887312e9b4a5-feast-data\") pod \"33f84cd4-4767-4375-98b0-887312e9b4a5\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") "
Sep 17 16:47:01.377535 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.377510    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls\") pod \"33f84cd4-4767-4375-98b0-887312e9b4a5\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") "
Sep 17 16:47:01.377642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.377540    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzbm8\" (UniqueName: \"kubernetes.io/projected/33f84cd4-4767-4375-98b0-887312e9b4a5-kube-api-access-nzbm8\") pod \"33f84cd4-4767-4375-98b0-887312e9b4a5\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") "
Sep 17 16:47:01.377642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.377569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-ui-tls\") pod \"33f84cd4-4767-4375-98b0-887312e9b4a5\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") "
Sep 17 16:47:01.377642 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.377637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-registry-tls\") pod \"33f84cd4-4767-4375-98b0-887312e9b4a5\" (UID: \"33f84cd4-4767-4375-98b0-887312e9b4a5\") "
Sep 17 16:47:01.378058 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.378026    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f84cd4-4767-4375-98b0-887312e9b4a5-feast-data" (OuterVolumeSpecName: "feast-data") pod "33f84cd4-4767-4375-98b0-887312e9b4a5" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:47:01.379853 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.379828    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "33f84cd4-4767-4375-98b0-887312e9b4a5" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:47:01.379979 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.379949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "33f84cd4-4767-4375-98b0-887312e9b4a5" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:47:01.379979 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.379961    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f84cd4-4767-4375-98b0-887312e9b4a5-kube-api-access-nzbm8" (OuterVolumeSpecName: "kube-api-access-nzbm8") pod "33f84cd4-4767-4375-98b0-887312e9b4a5" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5"). InnerVolumeSpecName "kube-api-access-nzbm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:47:01.380248 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.380230    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls" (OuterVolumeSpecName: "online-tls") pod "33f84cd4-4767-4375-98b0-887312e9b4a5" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:47:01.380288 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.380249    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "33f84cd4-4767-4375-98b0-887312e9b4a5" (UID: "33f84cd4-4767-4375-98b0-887312e9b4a5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:47:01.478952 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.478919    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:47:01.478952 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.478952    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:47:01.479197 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.478966    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:47:01.479197 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.478978    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/33f84cd4-4767-4375-98b0-887312e9b4a5-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:47:01.479197 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.479016    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/33f84cd4-4767-4375-98b0-887312e9b4a5-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:47:01.479197 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.479029    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzbm8\" (UniqueName: \"kubernetes.io/projected/33f84cd4-4767-4375-98b0-887312e9b4a5-kube-api-access-nzbm8\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:47:01.481608 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481577    2582 generic.go:356] "Generic (PLEG): container finished" podID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerID="965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b" exitCode=137
Sep 17 16:47:01.481608 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481605    2582 generic.go:356] "Generic (PLEG): container finished" podID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerID="5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb" exitCode=137
Sep 17 16:47:01.481793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481640    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"
Sep 17 16:47:01.481793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"}
Sep 17 16:47:01.481793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481721    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"}
Sep 17 16:47:01.481793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd" event={"ID":"33f84cd4-4767-4375-98b0-887312e9b4a5","Type":"ContainerDied","Data":"2a5e6d1584f6785a3bf25e902e48fa7d86673e85ef53d7f0489cb4390f3d12c1"}
Sep 17 16:47:01.481793 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.481757    2582 scope.go:117] "RemoveContainer" containerID="944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"
Sep 17 16:47:01.490083 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.490062    2582 scope.go:117] "RemoveContainer" containerID="965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"
Sep 17 16:47:01.499701 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.498883    2582 scope.go:117] "RemoveContainer" containerID="68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"
Sep 17 16:47:01.508147 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.508121    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"]
Sep 17 16:47:01.508666 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.508650    2582 scope.go:117] "RemoveContainer" containerID="5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"
Sep 17 16:47:01.515096 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.515075    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7f8pd"]
Sep 17 16:47:01.516658 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.516644    2582 scope.go:117] "RemoveContainer" containerID="522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"
Sep 17 16:47:01.523842 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.523826    2582 scope.go:117] "RemoveContainer" containerID="0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"
Sep 17 16:47:01.530708 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.530691    2582 scope.go:117] "RemoveContainer" containerID="944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"
Sep 17 16:47:01.530990 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:47:01.530970    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450\": container with ID starting with 944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450 not found: ID does not exist" containerID="944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"
Sep 17 16:47:01.531041 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531002    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"} err="failed to get container status \"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450\": rpc error: code = NotFound desc = could not find container \"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450\": container with ID starting with 944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450 not found: ID does not exist"
Sep 17 16:47:01.531041 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531020    2582 scope.go:117] "RemoveContainer" containerID="965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"
Sep 17 16:47:01.531230 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:47:01.531212    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b\": container with ID starting with 965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b not found: ID does not exist" containerID="965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"
Sep 17 16:47:01.531271 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531234    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"} err="failed to get container status \"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b\": rpc error: code = NotFound desc = could not find container \"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b\": container with ID starting with 965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b not found: ID does not exist"
Sep 17 16:47:01.531271 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531248    2582 scope.go:117] "RemoveContainer" containerID="68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"
Sep 17 16:47:01.531517 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:47:01.531500    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86\": container with ID starting with 68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86 not found: ID does not exist" containerID="68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"
Sep 17 16:47:01.531579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531520    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"} err="failed to get container status \"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86\": rpc error: code = NotFound desc = could not find container \"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86\": container with ID starting with 68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86 not found: ID does not exist"
Sep 17 16:47:01.531579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531537    2582 scope.go:117] "RemoveContainer" containerID="5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"
Sep 17 16:47:01.531756 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:47:01.531739    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb\": container with ID starting with 5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb not found: ID does not exist" containerID="5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"
Sep 17 16:47:01.531807 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531763    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"} err="failed to get container status \"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb\": rpc error: code = NotFound desc = could not find container \"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb\": container with ID starting with 5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb not found: ID does not exist"
Sep 17 16:47:01.531807 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531780    2582 scope.go:117] "RemoveContainer" containerID="522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"
Sep 17 16:47:01.531984 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:47:01.531969    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f\": container with ID starting with 522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f not found: ID does not exist" containerID="522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"
Sep 17 16:47:01.532019 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531987    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"} err="failed to get container status \"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f\": rpc error: code = NotFound desc = could not find container \"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f\": container with ID starting with 522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f not found: ID does not exist"
Sep 17 16:47:01.532019 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.531998    2582 scope.go:117] "RemoveContainer" containerID="0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"
Sep 17 16:47:01.532246 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:47:01.532231    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf\": container with ID starting with 0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf not found: ID does not exist" containerID="0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"
Sep 17 16:47:01.532291 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532247    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"} err="failed to get container status \"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf\": rpc error: code = NotFound desc = could not find container \"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf\": container with ID starting with 0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf not found: ID does not exist"
Sep 17 16:47:01.532291 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532258    2582 scope.go:117] "RemoveContainer" containerID="944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"
Sep 17 16:47:01.532501 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532481    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450"} err="failed to get container status \"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450\": rpc error: code = NotFound desc = could not find container \"944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450\": container with ID starting with 944ae2fb3f8c607803efaddb5df1e88a7ca3c0ade04a9d50c191958c0b31e450 not found: ID does not exist"
Sep 17 16:47:01.532556 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532503    2582 scope.go:117] "RemoveContainer" containerID="965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"
Sep 17 16:47:01.532728 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532711    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b"} err="failed to get container status \"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b\": rpc error: code = NotFound desc = could not find container \"965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b\": container with ID starting with 965eabd1a044b15503a55f2f793f77fda6d51b628df94387c664a0397a6bbf7b not found: ID does not exist"
Sep 17 16:47:01.532773 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532729    2582 scope.go:117] "RemoveContainer" containerID="68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"
Sep 17 16:47:01.532933 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532917    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86"} err="failed to get container status \"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86\": rpc error: code = NotFound desc = could not find container \"68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86\": container with ID starting with 68d99dc2ed474afb7318ac40f42d540fae4651774fe4b7425250283f08307f86 not found: ID does not exist"
Sep 17 16:47:01.532975 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.532932    2582 scope.go:117] "RemoveContainer" containerID="5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"
Sep 17 16:47:01.533136 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.533105    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb"} err="failed to get container status \"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb\": rpc error: code = NotFound desc = could not find container \"5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb\": container with ID starting with 5804d6b7ad0ec87108fe928133c0214b5ee6cd71d203edbe1b7eb741d32f4adb not found: ID does not exist"
Sep 17 16:47:01.533178 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.533136    2582 scope.go:117] "RemoveContainer" containerID="522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"
Sep 17 16:47:01.533363 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.533345    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f"} err="failed to get container status \"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f\": rpc error: code = NotFound desc = could not find container \"522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f\": container with ID starting with 522f89a7fbf9a98d57f8588c9a64ab5622772b71ad79c57255f847a51f94bc5f not found: ID does not exist"
Sep 17 16:47:01.533429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.533364    2582 scope.go:117] "RemoveContainer" containerID="0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"
Sep 17 16:47:01.533636 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.533620    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf"} err="failed to get container status \"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf\": rpc error: code = NotFound desc = could not find container \"0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf\": container with ID starting with 0411eb31af65f87da4d0a6f175feca60d2bd547e667b9ccf9274d7d846303baf not found: ID does not exist"
Sep 17 16:47:01.857220 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:01.857190    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" path="/var/lib/kubelet/pods/33f84cd4-4767-4375-98b0-887312e9b4a5/volumes"
Sep 17 16:47:55.783886 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.783843    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"]
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784260    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="offline"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784279    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="offline"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784290    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="registry"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="registry"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784312    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="feast-init"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784320    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="feast-init"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784329    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="feast-apply"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784338    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="feast-apply"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784353    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784362    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784373    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online"
Sep 17 16:47:55.784453 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784380    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online"
Sep 17 16:47:55.785151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784487    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="online"
Sep 17 16:47:55.785151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784499    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="registry"
Sep 17 16:47:55.785151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784507    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="ui"
Sep 17 16:47:55.785151 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.784519    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f84cd4-4767-4375-98b0-887312e9b4a5" containerName="offline"
Sep 17 16:47:55.788120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.788101    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:55.791026 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.790871    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 17 16:47:55.791026 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.790885    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 17 16:47:55.791210 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.791022    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 17 16:47:55.791485 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.791468    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 17 16:47:55.791485 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.791474    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 17 16:47:55.791657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.791550    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 17 16:47:55.791738 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.791723    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-l5tcp\""
Sep 17 16:47:55.800720 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.800693    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"]
Sep 17 16:47:55.907335 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.907291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:55.907539 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.907345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1843a7a-0ea8-47dc-b247-25251b714d6e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:55.907539 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.907401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t782n\" (UniqueName: \"kubernetes.io/projected/d1843a7a-0ea8-47dc-b247-25251b714d6e-kube-api-access-t782n\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:55.907539 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.907441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:55.907539 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.907464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1843a7a-0ea8-47dc-b247-25251b714d6e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:55.907539 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:55.907489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.008923 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.008888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009115 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.008972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1843a7a-0ea8-47dc-b247-25251b714d6e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009235 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.009214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t782n\" (UniqueName: \"kubernetes.io/projected/d1843a7a-0ea8-47dc-b247-25251b714d6e-kube-api-access-t782n\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.009263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009295 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.009288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1843a7a-0ea8-47dc-b247-25251b714d6e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009416 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.009305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009970 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.009948    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1843a7a-0ea8-47dc-b247-25251b714d6e-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.009970 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.009962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1843a7a-0ea8-47dc-b247-25251b714d6e-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.011691 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.011672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.011774 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.011757    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.011818 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.011799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.021689 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.021665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t782n\" (UniqueName: \"kubernetes.io/projected/d1843a7a-0ea8-47dc-b247-25251b714d6e-kube-api-access-t782n\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-lqjc6\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.099805 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.099722    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:47:56.373955 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.373881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"]
Sep 17 16:47:56.377485 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:47:56.376822    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1843a7a_0ea8_47dc_b247_25251b714d6e.slice/crio-c467e467db0efa1aacf26ab715da8bc264267a467c8c4071dbee69d171c89e2d WatchSource:0}: Error finding container c467e467db0efa1aacf26ab715da8bc264267a467c8c4071dbee69d171c89e2d: Status 404 returned error can't find the container with id c467e467db0efa1aacf26ab715da8bc264267a467c8c4071dbee69d171c89e2d
Sep 17 16:47:56.691349 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.691251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerStarted","Data":"cae76668d75b77b6570dfafe688f2af3f5ac4258eb27d335a233716b340a7142"}
Sep 17 16:47:56.691349 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:47:56.691315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerStarted","Data":"c467e467db0efa1aacf26ab715da8bc264267a467c8c4071dbee69d171c89e2d"}
Sep 17 16:48:01.709822 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:01.709734    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerID="cae76668d75b77b6570dfafe688f2af3f5ac4258eb27d335a233716b340a7142" exitCode=0
Sep 17 16:48:01.710284 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:01.709816    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerDied","Data":"cae76668d75b77b6570dfafe688f2af3f5ac4258eb27d335a233716b340a7142"}
Sep 17 16:48:02.715043 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:02.715012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerStarted","Data":"c401107332954f8176e3bb240214ae91747aa9b3345c452a304b90c929a28655"}
Sep 17 16:48:27.810796 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:27.810762    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerID="c401107332954f8176e3bb240214ae91747aa9b3345c452a304b90c929a28655" exitCode=0
Sep 17 16:48:27.810796 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:27.810804    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerDied","Data":"c401107332954f8176e3bb240214ae91747aa9b3345c452a304b90c929a28655"}
Sep 17 16:48:28.819337 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:28.819295    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerStarted","Data":"3fbc03886feea8997000d4a798d0412af8060c43ae23dbcc7a7f74bf76102484"}
Sep 17 16:48:28.819842 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:28.819359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerStarted","Data":"f4b9e32d50e8a1731cc39c07ba202a076dd0ac65d1ffee3da3566a4ebaac78d8"}
Sep 17 16:48:28.819842 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:28.819412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerStarted","Data":"1fcd1dc7e810401677c49ff82eb650bb4a7b564ec44f76bf3d1c1b374123d74a"}
Sep 17 16:48:28.847838 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:28.847777    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podStartSLOduration=33.84775842 podStartE2EDuration="33.84775842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:48:28.845485187 +0000 UTC m=+1767.462381010" watchObservedRunningTime="2026-09-17 16:48:28.84775842 +0000 UTC m=+1767.464654484"
Sep 17 16:48:29.100429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:29.100305    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:29.100429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:29.100373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:29.100429 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:29.100412    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:29.101947 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:29.101903    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Sep 17 16:48:29.102076 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:29.101936    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Sep 17 16:48:29.102076 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:29.101955    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 17 16:48:32.100269 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:32.100229    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 17 16:48:32.100792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:32.100221    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Sep 17 16:48:32.100792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:32.100233    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Sep 17 16:48:35.100410 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:35.100350    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Sep 17 16:48:35.100893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:35.100349    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Sep 17 16:48:35.100893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:35.100352    2582 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 17 16:48:36.100358 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:36.100324    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:36.100556 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:36.100377    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:36.100556 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:36.100410    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:38.101348 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:38.101310    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:38.101774 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:38.101612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:38.102154 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:38.102137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:38.869979 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:38.869948    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:39.079363 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:39.079329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:48:40.683503 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:48:40.683472    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:49:01.847192 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:01.847164    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:49:01.849591 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:01.849571    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:49:41.884594 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:41.884559    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"]
Sep 17 16:49:41.885179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:41.884770    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" containerID="cri-o://1fcd1dc7e810401677c49ff82eb650bb4a7b564ec44f76bf3d1c1b374123d74a" gracePeriod=30
Sep 17 16:49:41.885179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:41.884855    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" containerID="cri-o://3fbc03886feea8997000d4a798d0412af8060c43ae23dbcc7a7f74bf76102484" gracePeriod=30
Sep 17 16:49:41.885179 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:41.884909    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline" containerID="cri-o://f4b9e32d50e8a1731cc39c07ba202a076dd0ac65d1ffee3da3566a4ebaac78d8" gracePeriod=30
Sep 17 16:49:42.050363 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:42.050325    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"]
Sep 17 16:49:42.050591 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:42.050570    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="registry" containerID="cri-o://4834b672776bd11645eb46bbb30edb0b562eab492d30b71f0feb6d23035d23c2" gracePeriod=30
Sep 17 16:49:42.050676 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:42.050648    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui" containerID="cri-o://cbc74ca1977dae1bb510980da2c0cda61691b7a90c193f19343bde77920bd0ed" gracePeriod=30
Sep 17 16:49:42.050740 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:42.050664    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="offline" containerID="cri-o://9313b3d38c3c22752be8175b1b8b0006a533220e4fb85e850519b789cebddb4b" gracePeriod=30
Sep 17 16:49:42.050803 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:42.050658    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online" containerID="cri-o://482bd0e6408da50c06009b9ba070eb1ad23a1a5592781581625ba07f194e431d" gracePeriod=30
Sep 17 16:49:43.089666 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.089575    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Sep 17 16:49:43.112481 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.112447    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerID="3fbc03886feea8997000d4a798d0412af8060c43ae23dbcc7a7f74bf76102484" exitCode=0
Sep 17 16:49:43.112481 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.112472    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerID="1fcd1dc7e810401677c49ff82eb650bb4a7b564ec44f76bf3d1c1b374123d74a" exitCode=0
Sep 17 16:49:43.112695 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.112517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerDied","Data":"3fbc03886feea8997000d4a798d0412af8060c43ae23dbcc7a7f74bf76102484"}
Sep 17 16:49:43.112695 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.112562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerDied","Data":"1fcd1dc7e810401677c49ff82eb650bb4a7b564ec44f76bf3d1c1b374123d74a"}
Sep 17 16:49:43.115359 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.115338    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerID="cbc74ca1977dae1bb510980da2c0cda61691b7a90c193f19343bde77920bd0ed" exitCode=0
Sep 17 16:49:43.115359 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.115355    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerID="482bd0e6408da50c06009b9ba070eb1ad23a1a5592781581625ba07f194e431d" exitCode=0
Sep 17 16:49:43.115506 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.115373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"cbc74ca1977dae1bb510980da2c0cda61691b7a90c193f19343bde77920bd0ed"}
Sep 17 16:49:43.115506 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.115418    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"482bd0e6408da50c06009b9ba070eb1ad23a1a5592781581625ba07f194e431d"}
Sep 17 16:49:43.452169 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:43.452080    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Sep 17 16:49:48.870368 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:48.870326    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Sep 17 16:49:49.872930 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:49.872894    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 17 16:49:53.089523 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:53.089483    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Sep 17 16:49:53.451432 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:53.451310    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Sep 17 16:49:58.870486 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:58.870445    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Sep 17 16:49:59.872712 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:49:59.872675    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 17 16:50:03.089889 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:03.089848    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Sep 17 16:50:03.090287 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:03.089968    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:50:03.452231 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:03.452132    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Sep 17 16:50:03.452425 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:03.452289    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:50:08.870399 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:08.870354    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Sep 17 16:50:08.870792 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:08.870487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:50:09.872893 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:09.872852    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 17 16:50:09.873271 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:09.872968    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:50:12.230221 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.230122    2582 generic.go:356] "Generic (PLEG): container finished" podID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerID="f4b9e32d50e8a1731cc39c07ba202a076dd0ac65d1ffee3da3566a4ebaac78d8" exitCode=137
Sep 17 16:50:12.230221 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.230192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerDied","Data":"f4b9e32d50e8a1731cc39c07ba202a076dd0ac65d1ffee3da3566a4ebaac78d8"}
Sep 17 16:50:12.233248 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.233230    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerID="9313b3d38c3c22752be8175b1b8b0006a533220e4fb85e850519b789cebddb4b" exitCode=137
Sep 17 16:50:12.233248 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.233245    2582 generic.go:356] "Generic (PLEG): container finished" podID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerID="4834b672776bd11645eb46bbb30edb0b562eab492d30b71f0feb6d23035d23c2" exitCode=137
Sep 17 16:50:12.233383 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.233271    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"9313b3d38c3c22752be8175b1b8b0006a533220e4fb85e850519b789cebddb4b"}
Sep 17 16:50:12.233383 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.233297    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"4834b672776bd11645eb46bbb30edb0b562eab492d30b71f0feb6d23035d23c2"}
Sep 17 16:50:12.523669 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.523644    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:50:12.589630 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.589590    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1843a7a-0ea8-47dc-b247-25251b714d6e-registry-tls\") pod \"d1843a7a-0ea8-47dc-b247-25251b714d6e\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") "
Sep 17 16:50:12.589826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.589638    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-ui-tls\") pod \"d1843a7a-0ea8-47dc-b247-25251b714d6e\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") "
Sep 17 16:50:12.589826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.589671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-online-tls\") pod \"d1843a7a-0ea8-47dc-b247-25251b714d6e\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") "
Sep 17 16:50:12.589826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.589709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-offline-tls\") pod \"d1843a7a-0ea8-47dc-b247-25251b714d6e\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") "
Sep 17 16:50:12.589826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.589740    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t782n\" (UniqueName: \"kubernetes.io/projected/d1843a7a-0ea8-47dc-b247-25251b714d6e-kube-api-access-t782n\") pod \"d1843a7a-0ea8-47dc-b247-25251b714d6e\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") "
Sep 17 16:50:12.589826 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.589775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1843a7a-0ea8-47dc-b247-25251b714d6e-feast-data\") pod \"d1843a7a-0ea8-47dc-b247-25251b714d6e\" (UID: \"d1843a7a-0ea8-47dc-b247-25251b714d6e\") "
Sep 17 16:50:12.590133 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.590106    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1843a7a-0ea8-47dc-b247-25251b714d6e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d1843a7a-0ea8-47dc-b247-25251b714d6e" (UID: "d1843a7a-0ea8-47dc-b247-25251b714d6e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 16:50:12.590474 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.590450    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1843a7a-0ea8-47dc-b247-25251b714d6e-feast-data" (OuterVolumeSpecName: "feast-data") pod "d1843a7a-0ea8-47dc-b247-25251b714d6e" (UID: "d1843a7a-0ea8-47dc-b247-25251b714d6e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:50:12.592804 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.592777    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-online-tls" (OuterVolumeSpecName: "online-tls") pod "d1843a7a-0ea8-47dc-b247-25251b714d6e" (UID: "d1843a7a-0ea8-47dc-b247-25251b714d6e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.592920 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.592796    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d1843a7a-0ea8-47dc-b247-25251b714d6e" (UID: "d1843a7a-0ea8-47dc-b247-25251b714d6e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.592920 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.592837    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d1843a7a-0ea8-47dc-b247-25251b714d6e" (UID: "d1843a7a-0ea8-47dc-b247-25251b714d6e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.592920 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.592862    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1843a7a-0ea8-47dc-b247-25251b714d6e-kube-api-access-t782n" (OuterVolumeSpecName: "kube-api-access-t782n") pod "d1843a7a-0ea8-47dc-b247-25251b714d6e" (UID: "d1843a7a-0ea8-47dc-b247-25251b714d6e"). InnerVolumeSpecName "kube-api-access-t782n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:50:12.690335 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.690311    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d1843a7a-0ea8-47dc-b247-25251b714d6e-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.690335 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.690337    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d1843a7a-0ea8-47dc-b247-25251b714d6e-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.690548 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.690346    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.690548 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.690354    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.690548 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.690361    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d1843a7a-0ea8-47dc-b247-25251b714d6e-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.690548 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.690369    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t782n\" (UniqueName: \"kubernetes.io/projected/d1843a7a-0ea8-47dc-b247-25251b714d6e-kube-api-access-t782n\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.694252 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.694233    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:50:12.790765 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.790735    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-online-tls\") pod \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") "
Sep 17 16:50:12.790944 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.790770    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls\") pod \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") "
Sep 17 16:50:12.790944 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.790830    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4nqj\" (UniqueName: \"kubernetes.io/projected/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-kube-api-access-s4nqj\") pod \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") "
Sep 17 16:50:12.791064 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.790999    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-registry-tls\") pod \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") "
Sep 17 16:50:12.791064 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.791045    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-offline-tls\") pod \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") "
Sep 17 16:50:12.791168 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.791096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-feast-data\") pod \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\" (UID: \"d83970a9-ebd3-44f5-a3e3-19b11a426bf6\") "
Sep 17 16:50:12.791741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.791711    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-feast-data" (OuterVolumeSpecName: "feast-data") pod "d83970a9-ebd3-44f5-a3e3-19b11a426bf6" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:50:12.793132 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.793112    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d83970a9-ebd3-44f5-a3e3-19b11a426bf6" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.793611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.793581    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d83970a9-ebd3-44f5-a3e3-19b11a426bf6" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.793611 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.793599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-online-tls" (OuterVolumeSpecName: "online-tls") pod "d83970a9-ebd3-44f5-a3e3-19b11a426bf6" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.793749 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.793663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d83970a9-ebd3-44f5-a3e3-19b11a426bf6" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 16:50:12.793749 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.793673    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-kube-api-access-s4nqj" (OuterVolumeSpecName: "kube-api-access-s4nqj") pod "d83970a9-ebd3-44f5-a3e3-19b11a426bf6" (UID: "d83970a9-ebd3-44f5-a3e3-19b11a426bf6"). InnerVolumeSpecName "kube-api-access-s4nqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:50:12.892022 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.891987    2582 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-feast-data\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.892022 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.892014    2582 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-online-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.892022 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.892021    2582 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-ui-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.892235 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.892032    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4nqj\" (UniqueName: \"kubernetes.io/projected/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-kube-api-access-s4nqj\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.892235 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.892042    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-registry-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:12.892235 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:12.892050    2582 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d83970a9-ebd3-44f5-a3e3-19b11a426bf6-offline-tls\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:13.239240 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.239161    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"
Sep 17 16:50:13.239240 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.239176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6" event={"ID":"d1843a7a-0ea8-47dc-b247-25251b714d6e","Type":"ContainerDied","Data":"c467e467db0efa1aacf26ab715da8bc264267a467c8c4071dbee69d171c89e2d"}
Sep 17 16:50:13.239745 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.239235    2582 scope.go:117] "RemoveContainer" containerID="3fbc03886feea8997000d4a798d0412af8060c43ae23dbcc7a7f74bf76102484"
Sep 17 16:50:13.242175 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.242154    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk" event={"ID":"d83970a9-ebd3-44f5-a3e3-19b11a426bf6","Type":"ContainerDied","Data":"f8566d2d8de56f3e245532b9ff57a9af5a60b612cf575b7812a82bb5e8385656"}
Sep 17 16:50:13.242268 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.242182    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"
Sep 17 16:50:13.250825 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.250795    2582 scope.go:117] "RemoveContainer" containerID="f4b9e32d50e8a1731cc39c07ba202a076dd0ac65d1ffee3da3566a4ebaac78d8"
Sep 17 16:50:13.259259 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.259242    2582 scope.go:117] "RemoveContainer" containerID="1fcd1dc7e810401677c49ff82eb650bb4a7b564ec44f76bf3d1c1b374123d74a"
Sep 17 16:50:13.267116 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.267097    2582 scope.go:117] "RemoveContainer" containerID="c401107332954f8176e3bb240214ae91747aa9b3345c452a304b90c929a28655"
Sep 17 16:50:13.270282 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.270257    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"]
Sep 17 16:50:13.275157 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.275134    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tkzwk"]
Sep 17 16:50:13.275524 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.275508    2582 scope.go:117] "RemoveContainer" containerID="cae76668d75b77b6570dfafe688f2af3f5ac4258eb27d335a233716b340a7142"
Sep 17 16:50:13.282957 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.282939    2582 scope.go:117] "RemoveContainer" containerID="cbc74ca1977dae1bb510980da2c0cda61691b7a90c193f19343bde77920bd0ed"
Sep 17 16:50:13.290425 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.290406    2582 scope.go:117] "RemoveContainer" containerID="9313b3d38c3c22752be8175b1b8b0006a533220e4fb85e850519b789cebddb4b"
Sep 17 16:50:13.290838 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.290821    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"]
Sep 17 16:50:13.295934 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.295909    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-lqjc6"]
Sep 17 16:50:13.298495 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.298479    2582 scope.go:117] "RemoveContainer" containerID="482bd0e6408da50c06009b9ba070eb1ad23a1a5592781581625ba07f194e431d"
Sep 17 16:50:13.305986 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.305966    2582 scope.go:117] "RemoveContainer" containerID="4834b672776bd11645eb46bbb30edb0b562eab492d30b71f0feb6d23035d23c2"
Sep 17 16:50:13.313120 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.313102    2582 scope.go:117] "RemoveContainer" containerID="7922c743f8b0b2d11fabbd88a7c650cbeccfff56a17a6fa9d7d1ef68109d2cef"
Sep 17 16:50:13.320186 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.320169    2582 scope.go:117] "RemoveContainer" containerID="913f0116a064979fb6349b061b284ba9fb111a5a47117efd58e45ffb2e474607"
Sep 17 16:50:13.856309 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.856277    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" path="/var/lib/kubelet/pods/d1843a7a-0ea8-47dc-b247-25251b714d6e/volumes"
Sep 17 16:50:13.856828 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:13.856814    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" path="/var/lib/kubelet/pods/d83970a9-ebd3-44f5-a3e3-19b11a426bf6/volumes"
Sep 17 16:50:31.887146 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887070    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ssqh5/must-gather-b65nh"]
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887331    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="registry"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887342    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="registry"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887354    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="offline"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887359    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="offline"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887366    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="feast-apply"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887372    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="feast-apply"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887377    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="feast-init"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887383    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="feast-init"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887406    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="feast-init"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887411    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="feast-init"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887418    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887423    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887434    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887439    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887444    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887449    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887454    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887460    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887465    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="feast-apply"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887470    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="feast-apply"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887475    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui"
Sep 17 16:50:31.887498 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887480    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887524    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="ui"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887531    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="online"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887537    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="offline"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887542    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="offline"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887548    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="ui"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887554    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1843a7a-0ea8-47dc-b247-25251b714d6e" containerName="online"
Sep 17 16:50:31.888160 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.887561    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83970a9-ebd3-44f5-a3e3-19b11a426bf6" containerName="registry"
Sep 17 16:50:31.892505 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.892481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:31.894970 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.894946    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ssqh5\"/\"default-dockercfg-b876h\""
Sep 17 16:50:31.895105 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.894970    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ssqh5\"/\"kube-root-ca.crt\""
Sep 17 16:50:31.896001 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.895981    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ssqh5\"/\"openshift-service-ca.crt\""
Sep 17 16:50:31.902106 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:31.902084    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ssqh5/must-gather-b65nh"]
Sep 17 16:50:32.034916 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.034875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8df7d30f-5841-43a8-a032-f6af737f10bd-must-gather-output\") pod \"must-gather-b65nh\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") " pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.035086 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.034962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkw2\" (UniqueName: \"kubernetes.io/projected/8df7d30f-5841-43a8-a032-f6af737f10bd-kube-api-access-bgkw2\") pod \"must-gather-b65nh\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") " pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.135908 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.135873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkw2\" (UniqueName: \"kubernetes.io/projected/8df7d30f-5841-43a8-a032-f6af737f10bd-kube-api-access-bgkw2\") pod \"must-gather-b65nh\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") " pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.136119 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.135932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8df7d30f-5841-43a8-a032-f6af737f10bd-must-gather-output\") pod \"must-gather-b65nh\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") " pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.136222 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.136206    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8df7d30f-5841-43a8-a032-f6af737f10bd-must-gather-output\") pod \"must-gather-b65nh\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") " pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.144614 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.144543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkw2\" (UniqueName: \"kubernetes.io/projected/8df7d30f-5841-43a8-a032-f6af737f10bd-kube-api-access-bgkw2\") pod \"must-gather-b65nh\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") " pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.220580 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.220523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:32.491261 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.491229    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ssqh5/must-gather-b65nh"]
Sep 17 16:50:32.493962 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:50:32.493935    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8df7d30f_5841_43a8_a032_f6af737f10bd.slice/crio-1eda8faf063f9d4410d327fe7bcebdf5a977dbd82a81ca6f1bfb81fa8088cc42 WatchSource:0}: Error finding container 1eda8faf063f9d4410d327fe7bcebdf5a977dbd82a81ca6f1bfb81fa8088cc42: Status 404 returned error can't find the container with id 1eda8faf063f9d4410d327fe7bcebdf5a977dbd82a81ca6f1bfb81fa8088cc42
Sep 17 16:50:32.495801 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:32.495783    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 16:50:33.326759 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:33.326687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssqh5/must-gather-b65nh" event={"ID":"8df7d30f-5841-43a8-a032-f6af737f10bd","Type":"ContainerStarted","Data":"1eda8faf063f9d4410d327fe7bcebdf5a977dbd82a81ca6f1bfb81fa8088cc42"}
Sep 17 16:50:39.354758 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:39.354723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssqh5/must-gather-b65nh" event={"ID":"8df7d30f-5841-43a8-a032-f6af737f10bd","Type":"ContainerStarted","Data":"64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04"}
Sep 17 16:50:39.355118 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:39.354771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssqh5/must-gather-b65nh" event={"ID":"8df7d30f-5841-43a8-a032-f6af737f10bd","Type":"ContainerStarted","Data":"ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"}
Sep 17 16:50:39.379904 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:39.379854    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ssqh5/must-gather-b65nh" podStartSLOduration=2.28559787 podStartE2EDuration="8.379839967s" totalImagesPullingTime="6.094242097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 16:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:50:39.379315463 +0000 UTC m=+1897.996211388" watchObservedRunningTime="2026-09-17 16:50:39.379839967 +0000 UTC m=+1897.996735791"
Sep 17 16:50:48.389384 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:48.389350    2582 generic.go:356] "Generic (PLEG): container finished" podID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerID="ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a" exitCode=0
Sep 17 16:50:48.389797 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:48.389428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ssqh5/must-gather-b65nh" event={"ID":"8df7d30f-5841-43a8-a032-f6af737f10bd","Type":"ContainerDied","Data":"ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"}
Sep 17 16:50:48.389797 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:48.389732    2582 scope.go:117] "RemoveContainer" containerID="ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"
Sep 17 16:50:49.350358 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:49.350328    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ssqh5_must-gather-b65nh_8df7d30f-5841-43a8-a032-f6af737f10bd/gather/0.log"
Sep 17 16:50:53.067671 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:53.067637    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k6kvk_5c87a9f8-de64-442a-9e45-41b6448a2840/global-pull-secret-syncer/0.log"
Sep 17 16:50:53.201404 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:53.201365    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zvmpq_66c88570-814c-4148-88c6-b4b18f6caf60/konnectivity-agent/0.log"
Sep 17 16:50:53.228616 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:53.228587    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-87.ec2.internal_b0b7dfb22338a242f82fb89abf533158/haproxy/0.log"
Sep 17 16:50:54.681135 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:54.681100    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ssqh5/must-gather-b65nh"]
Sep 17 16:50:54.681566 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:54.681315    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-ssqh5/must-gather-b65nh" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="copy" containerID="cri-o://64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04" gracePeriod=2
Sep 17 16:50:54.688319 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:54.688292    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ssqh5/must-gather-b65nh"]
Sep 17 16:50:54.689346 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:50:54.689317    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8df7d30f-5841-43a8-a032-f6af737f10bd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-ssqh5\"/\"must-gather-b65nh\": pods \"must-gather-b65nh\" not found" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:54.923405 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:54.923366    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ssqh5_must-gather-b65nh_8df7d30f-5841-43a8-a032-f6af737f10bd/copy/0.log"
Sep 17 16:50:54.924964 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:54.924947    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:54.927546 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:50:54.927521    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b65nh\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ssqh5\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:55.020372 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.020270    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgkw2\" (UniqueName: \"kubernetes.io/projected/8df7d30f-5841-43a8-a032-f6af737f10bd-kube-api-access-bgkw2\") pod \"8df7d30f-5841-43a8-a032-f6af737f10bd\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") "
Sep 17 16:50:55.020579 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.020381    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8df7d30f-5841-43a8-a032-f6af737f10bd-must-gather-output\") pod \"8df7d30f-5841-43a8-a032-f6af737f10bd\" (UID: \"8df7d30f-5841-43a8-a032-f6af737f10bd\") "
Sep 17 16:50:55.020775 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.020742    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8df7d30f-5841-43a8-a032-f6af737f10bd-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "8df7d30f-5841-43a8-a032-f6af737f10bd" (UID: "8df7d30f-5841-43a8-a032-f6af737f10bd"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 16:50:55.022699 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.022679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df7d30f-5841-43a8-a032-f6af737f10bd-kube-api-access-bgkw2" (OuterVolumeSpecName: "kube-api-access-bgkw2") pod "8df7d30f-5841-43a8-a032-f6af737f10bd" (UID: "8df7d30f-5841-43a8-a032-f6af737f10bd"). InnerVolumeSpecName "kube-api-access-bgkw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 16:50:55.121845 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.121798    2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8df7d30f-5841-43a8-a032-f6af737f10bd-must-gather-output\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:55.121845 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.121837    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgkw2\" (UniqueName: \"kubernetes.io/projected/8df7d30f-5841-43a8-a032-f6af737f10bd-kube-api-access-bgkw2\") on node \"ip-10-0-128-87.ec2.internal\" DevicePath \"\""
Sep 17 16:50:55.415641 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.415616    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ssqh5_must-gather-b65nh_8df7d30f-5841-43a8-a032-f6af737f10bd/copy/0.log"
Sep 17 16:50:55.416007 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.415988    2582 generic.go:356] "Generic (PLEG): container finished" podID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerID="64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04" exitCode=143
Sep 17 16:50:55.416052 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.416037    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:55.416088 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.416056    2582 scope.go:117] "RemoveContainer" containerID="64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04"
Sep 17 16:50:55.418227 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:50:55.418198    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b65nh\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ssqh5\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:55.426716 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:50:55.426687    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-b65nh\" is forbidden: User \"system:node:ip-10-0-128-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ssqh5\": no relationship found between node 'ip-10-0-128-87.ec2.internal' and this object" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" pod="openshift-must-gather-ssqh5/must-gather-b65nh"
Sep 17 16:50:55.426781 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.426713    2582 scope.go:117] "RemoveContainer" containerID="ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"
Sep 17 16:50:55.437596 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.437576    2582 scope.go:117] "RemoveContainer" containerID="64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04"
Sep 17 16:50:55.437888 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:50:55.437869    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04\": container with ID starting with 64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04 not found: ID does not exist" containerID="64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04"
Sep 17 16:50:55.437939 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.437897    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04"} err="failed to get container status \"64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04\": rpc error: code = NotFound desc = could not find container \"64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04\": container with ID starting with 64aefbe786331ef6d73afa156b98d61521a29856ab00d4021d35077cdf157c04 not found: ID does not exist"
Sep 17 16:50:55.437939 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.437915    2582 scope.go:117] "RemoveContainer" containerID="ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"
Sep 17 16:50:55.438203 ip-10-0-128-87 kubenswrapper[2582]: E0917 16:50:55.438184    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a\": container with ID starting with ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a not found: ID does not exist" containerID="ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"
Sep 17 16:50:55.438260 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.438209    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a"} err="failed to get container status \"ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a\": rpc error: code = NotFound desc = could not find container \"ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a\": container with ID starting with ce0a8d4ba30787a85eaae4d6f2047b3b06e8acb62ccdc3c702bfdf34a816464a not found: ID does not exist"
Sep 17 16:50:55.856740 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:55.856708    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" path="/var/lib/kubelet/pods/8df7d30f-5841-43a8-a032-f6af737f10bd/volumes"
Sep 17 16:50:57.356345 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:57.356266    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8btrz_41a2b0ec-75ae-4388-9764-a1cf812a3bbd/node-exporter/0.log"
Sep 17 16:50:57.384069 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:57.384047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8btrz_41a2b0ec-75ae-4388-9764-a1cf812a3bbd/kube-rbac-proxy/0.log"
Sep 17 16:50:57.412818 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:57.412791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8btrz_41a2b0ec-75ae-4388-9764-a1cf812a3bbd/init-textfile/0.log"
Sep 17 16:50:58.000098 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:58.000063    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6944c64d5d-tbcnf_fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9/telemeter-client/0.log"
Sep 17 16:50:58.047922 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:58.047892    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6944c64d5d-tbcnf_fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9/reload/0.log"
Sep 17 16:50:58.093862 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:50:58.093830    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6944c64d5d-tbcnf_fbb3e8b2-6cb4-475c-adc5-9ea39472b8f9/kube-rbac-proxy/0.log"
Sep 17 16:51:00.003787 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.003758    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/1.log"
Sep 17 16:51:00.007740 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.007718    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-dj7lp_3c978f3f-b1dc-45f7-a03f-a20d665d6fe4/console-operator/2.log"
Sep 17 16:51:00.815332 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815298    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"]
Sep 17 16:51:00.815657 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815640    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="copy"
Sep 17 16:51:00.815741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="copy"
Sep 17 16:51:00.815741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815689    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="gather"
Sep 17 16:51:00.815741 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815697    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="gather"
Sep 17 16:51:00.815892 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815765    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="gather"
Sep 17 16:51:00.815892 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.815778    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df7d30f-5841-43a8-a032-f6af737f10bd" containerName="copy"
Sep 17 16:51:00.818856 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.818834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.821461 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.821373    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6djb8\"/\"kube-root-ca.crt\""
Sep 17 16:51:00.821562 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.821477    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6djb8\"/\"openshift-service-ca.crt\""
Sep 17 16:51:00.821562 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.821518    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6djb8\"/\"default-dockercfg-xcgp9\""
Sep 17 16:51:00.832383 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.832360    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"]
Sep 17 16:51:00.862344 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.862318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr8pc\" (UniqueName: \"kubernetes.io/projected/725541e3-11fe-4e42-9f38-77ed6afbbc36-kube-api-access-zr8pc\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.862506 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.862353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-lib-modules\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.862506 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.862403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-podres\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.862506 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.862490    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-sys\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.862639 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.862526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-proc\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-sys\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963567 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-proc\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr8pc\" (UniqueName: \"kubernetes.io/projected/725541e3-11fe-4e42-9f38-77ed6afbbc36-kube-api-access-zr8pc\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-lib-modules\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-sys\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-proc\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963761 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-podres\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963928 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-lib-modules\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.963928 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.963770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/725541e3-11fe-4e42-9f38-77ed6afbbc36-podres\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:00.973988 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:00.973959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr8pc\" (UniqueName: \"kubernetes.io/projected/725541e3-11fe-4e42-9f38-77ed6afbbc36-kube-api-access-zr8pc\") pod \"perf-node-gather-daemonset-wxssg\" (UID: \"725541e3-11fe-4e42-9f38-77ed6afbbc36\") " pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:01.128104 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:01.128001    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:01.415669 ip-10-0-128-87 kubenswrapper[2582]: W0917 16:51:01.415639    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod725541e3_11fe_4e42_9f38_77ed6afbbc36.slice/crio-823dd13ecbe63b9fd3dc2c9392a8e8adbe3b16923dd3633dc331fc52675ef420 WatchSource:0}: Error finding container 823dd13ecbe63b9fd3dc2c9392a8e8adbe3b16923dd3633dc331fc52675ef420: Status 404 returned error can't find the container with id 823dd13ecbe63b9fd3dc2c9392a8e8adbe3b16923dd3633dc331fc52675ef420
Sep 17 16:51:01.416765 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:01.416741    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"]
Sep 17 16:51:01.438355 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:01.438331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg" event={"ID":"725541e3-11fe-4e42-9f38-77ed6afbbc36","Type":"ContainerStarted","Data":"823dd13ecbe63b9fd3dc2c9392a8e8adbe3b16923dd3633dc331fc52675ef420"}
Sep 17 16:51:01.917443 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:01.917418    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vpk7_f3357b42-4959-4ec0-afc5-f46447c539d7/dns/0.log"
Sep 17 16:51:01.944109 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:01.944087    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7vpk7_f3357b42-4959-4ec0-afc5-f46447c539d7/kube-rbac-proxy/0.log"
Sep 17 16:51:02.091702 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:02.091679    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftr9x_9bbe7c5d-6104-42d8-beee-163d4d2a8953/dns-node-resolver/0.log"
Sep 17 16:51:02.443570 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:02.443535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg" event={"ID":"725541e3-11fe-4e42-9f38-77ed6afbbc36","Type":"ContainerStarted","Data":"7856bdb5bed970efe4ed58780ea3d62b368115729dede83cf45a9f434738d132"}
Sep 17 16:51:02.443984 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:02.443667    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:02.460883 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:02.460835    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg" podStartSLOduration=2.460819963 podStartE2EDuration="2.460819963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 16:51:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 16:51:02.459798355 +0000 UTC m=+1921.076694177" watchObservedRunningTime="2026-09-17 16:51:02.460819963 +0000 UTC m=+1921.077715785"
Sep 17 16:51:02.643024 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:02.642996    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c7bhg_b9f055da-addd-48a6-b837-9becc8d45ed2/node-ca/0.log"
Sep 17 16:51:03.477828 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:03.477801    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d54ddbbd6-gmj2s_6b0e2b80-2805-4c9f-ab23-c742a273311e/router/0.log"
Sep 17 16:51:03.871716 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:03.871690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fg78m_069ac91f-a50e-4868-bf37-739b1973f072/serve-healthcheck-canary/0.log"
Sep 17 16:51:04.549365 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:04.549338    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g2w9t_023a78eb-eb67-46c7-9cbb-ea60ff4b397f/kube-rbac-proxy/0.log"
Sep 17 16:51:04.573974 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:04.573954    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g2w9t_023a78eb-eb67-46c7-9cbb-ea60ff4b397f/exporter/0.log"
Sep 17 16:51:04.600717 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:04.600694    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g2w9t_023a78eb-eb67-46c7-9cbb-ea60ff4b397f/extractor/0.log"
Sep 17 16:51:08.456808 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:08.456780    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6djb8/perf-node-gather-daemonset-wxssg"
Sep 17 16:51:09.185020 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:09.184881    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-rhf9z_b74961b7-1e9e-4509-8356-e88368402b70/migrator/0.log"
Sep 17 16:51:09.213109 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:09.213090    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-rhf9z_b74961b7-1e9e-4509-8356-e88368402b70/graceful-termination/0.log"
Sep 17 16:51:09.611296 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:09.611242    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-zbkqh_df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321/kube-storage-version-migrator-operator/1.log"
Sep 17 16:51:09.612067 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:09.612048    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-zbkqh_df6ebbdf-7e4f-4b98-97a1-1c80a9dd8321/kube-storage-version-migrator-operator/0.log"
Sep 17 16:51:10.960370 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:10.960283    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/kube-multus-additional-cni-plugins/0.log"
Sep 17 16:51:10.993643 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:10.993619    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/egress-router-binary-copy/0.log"
Sep 17 16:51:11.017419 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.017377    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/cni-plugins/0.log"
Sep 17 16:51:11.039885 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.039849    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/bond-cni-plugin/0.log"
Sep 17 16:51:11.063130 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.063106    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/routeoverride-cni/0.log"
Sep 17 16:51:11.085730 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.085681    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/whereabouts-cni-bincopy/0.log"
Sep 17 16:51:11.110224 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.110199    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p4bdq_e84097a3-915a-4787-a984-d2c92e853e0e/whereabouts-cni/0.log"
Sep 17 16:51:11.327637 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.327600    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bqtzg_9824dbfb-2fc9-4676-85e7-935284479f67/kube-multus/0.log"
Sep 17 16:51:11.451059 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.451019    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kn6qg_fb2bcc30-f652-4940-86fb-dcc30bee1e11/network-metrics-daemon/0.log"
Sep 17 16:51:11.477483 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:11.477462    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kn6qg_fb2bcc30-f652-4940-86fb-dcc30bee1e11/kube-rbac-proxy/0.log"
Sep 17 16:51:12.859223 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:12.859187    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/ovn-controller/0.log"
Sep 17 16:51:12.884758 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:12.884728    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/ovn-acl-logging/0.log"
Sep 17 16:51:12.924308 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:12.924279    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/kube-rbac-proxy-node/0.log"
Sep 17 16:51:12.958592 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:12.958557    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 16:51:12.987246 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:12.987219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/northd/0.log"
Sep 17 16:51:13.031282 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:13.031256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/nbdb/0.log"
Sep 17 16:51:13.092872 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:13.092850    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/sbdb/0.log"
Sep 17 16:51:13.161265 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:13.161191    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wxgq2_d12b72b5-0f10-4b23-a01a-f210a25796bc/ovnkube-controller/0.log"
Sep 17 16:51:14.299593 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:14.299557    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nxrgg_ba28ffc6-2b98-4648-aba1-a0e843065769/network-check-target-container/0.log"
Sep 17 16:51:15.481125 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:15.481098    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-4skrg_e5aec1bf-1102-4a94-8953-5012ae95a82d/iptables-alerter/0.log"
Sep 17 16:51:16.316169 ip-10-0-128-87 kubenswrapper[2582]: I0917 16:51:16.316145    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-7bzn5_3979f2d0-d1ab-466e-8016-c79da49a3261/tuned/0.log"